Unitary Representations and Osterwalder-Schrader Duality 

Palle E. T. Jorgensen and Gestur Olafsson 

Dedicated to the memory of Irving E. Segal 

Abstract. The notions of reflection, symmetry, and positivity from quantum 
field theory are shown to induce a duality operation for a general class of uni- 
tary representations of Lie groups. The semisimple Lie groups which have this 
c-duality are identified and they are placed in the context of Harish-Chandra's 
legacy for the unitary representations program. Our paper begins with a dis- 
cussion of path space measures, which is the setting where reflection positivity 
(Osterwalder-Schrader) was first identified as a useful tool of analysis. 



Le plus court chemin entre deux verites dans 
le domaine reel passe par le domaine complexe. 

— Jacques Hadamard 



Introduction 

In this paper, we present an idea which serves to unify the following six different 
developments: 

(i) reflection positivity of quantum field theory, 

(ii) the role of reflection positivity in functional integration, 

(iii) the spectral theory of unitary one-parameter groups in Hilbert space, 

(iv) an extension principle for operators in Hilbert space, 

(v) the Bargmann transform, and 

(vi) reflection positivity and unitary highest weight modules for semisimple Lie 
groups. 

The emphasis is on (vi), but the common thread in our paper is the unity of 
the six areas, which, on the face of it, may perhaps appear to be unrelated. We 
also stress the interconnection between the six projects, and especially the impact 
on (vi) from (i)-(v). 

Readers who may not be familiar with all six of the subjects (i)~(vi) may wish 
to consult the bibliography; for example [17] is an excellent background reference 
on (i)-(ii), [15] is especially useful on (ii), and [1] covers the theory underlying (iii). 
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Area (iv) is covered in [40] and [45], while [20] and [78] cover (v). Background 
references on (vi) include [46], [41], and [42]. 

Our main point is to show how the concepts of reflection, symmetry and pos- 
itivity, which are central notions in quantum field theory, are related to a duality 
operation for certain imitary representations of semisimple Lie groups. On the 
group level this duality corresponds to the c-duality of causal symmetric spaces, 
a duality relating the "compactly causal" spaces to the "non-compactly causal" 
spaces. On the level of representations one starts with a unitary representation of 
a group G with an involution t corresponding to a non-compactly causal space, 
then uses an involution on the representation space satisfying a certain positivity 
condition on a subspace to produce a contraction representation of a semigroup 
H exp (C) , where H = G'^ and C is an iJ-invariant convex cone lying in the space 
of r-fixed points in the Lie algebra. Now a general result of Liischer and Mack and 
the co-authors can be used to produce a unitary representation of the c-dual group 
G'^ on the same space. (See [33], [31], [60], and [74] for these terms.) 

We aim to address several target audiences: workers in representation theory, 
mathematical physicists, and specialists in transform theory. This diversity has 
necessitated the inclusion of a bit more background material than would perhaps 
otherwise be called for: certain ideas are typically explained slightly differently in 
the context of mathematical physics from what is customary among specialists in 
one or more of the other areas. 

The symmetry group for classical mechanics is the Euclidean motion group 
En = SO{n) Xsp R", where the subscript gp stands for semidirect product. Here 
the action of (A, x) G En on R" is given by (^,x) • v = ^(v) -|- x, that is SO{n) 
acts by rotations and M" acts by translations. The connected symmetry group for 
the space-time of relativity is the Poincare group P„ = SOo{n — 1, 1) (E)sp Let 
Xn stand for the time coordinate, that is t = x„. Those two symmetry groups 
of physics are related by transition to imaginary time, that is multiplying a;„ by i. 
This in particular changes the usual Euclidean form (x | y) = Xiyn + - ■ ■ + Xnyn into 
the Lorentz form g„_i^i(x, y) = xiyi -|- • • • -|- Xn-iVn-i — XuVni which is invariant 
under the group SOo{n — 1,1). Those groups and the corresponding geometry can 
be related by the c-duality. Define an involution r : — > by 



The differential r : e,i ^ e,i is given by the same formula, and r is an involution on 
en- Let 



A simple calculation shows that e„ ~ p„. Let G = En and let denote the simply 
connected Lie group with Lie algebra Then G^ = Pn, the universal covering 
group of Pn- 

Given that a physical system is determined by a unitary representation (tt, H(7r)) 
of the symmetry group, in our case En and Pn, the problem is reduced to use "ana- 
lytic continuation" to move unitary representations of En to unitary representations 





f) :={X e tn I r(X) =X} ~so(n- 1) x.pW 
q :={X e tn I t{X) = -X} 
The c-dual Lie algebra is defined by: 

:= f) e iq . 
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of Pn by passing over to imaginary time. This idea was used in the paper by J. 
Frohlich, K. Ostcrwaldcr, and E. Seller in [15]. sec also [50], to construct quantum 
field theoretical systems using Euclidean field theory. In this paper we will give 
some general constructions and ideas related to this problem in the context of the 
applications (i) (v) mentioned above, and work out some simple examples. 

In [95] R. Schrader used this idea to construct, from a complementary se- 
ries representation of SL{2n, C), a unitary representation of the group SU (n, n) x 
SU (n, n) . In that paper the similarities to the Yang-Baxter relation were also dis- 
cussed, a theme that we will leave out in this exposition. What was missing in 
R. Schrader's paper was the identification of the resulting representations and a 
general procedure how to construct those representations. Wc will sec that wc can 
do this for all simple Lie groups where the associated Riemannian symmetric space 
G/K is a tube domain, and the that the duality works between complementary 
series representations and highest weight representations. 

In general this problem can be formulated in terms of c- duality of Lie groups 
and the analytic continuation of unitary representations from one real form to 
another. (See [33] for these terms.) The representations that show up in the 
case of semisimple groups are generalized principal series representations on the 
one side and highest weight representations on the other. The symmetric spaces 
are the causal symmetric spaces, and the duality is between non-compactly causal 
symmetric spaces and compactly causal symmetric spaces. The latter correspond 
bijectively to real forms of bounded symmetric domains. Therefore both the geom- 
etry and the representations are closely related to the work of Harish-Chandra on 
bounded symmetric domains and the holomorphic discrete series [21, 22, 23]. But 
the ideas are also related to the work of I. Segal and S. Paneitz through the notion 
of causality and invariant cones, [96, 86, 87]. A more complete exposure can be 
found in the joint paper by the coauthors: Unitary Representations of Lie Groups 
with Reflection Symmetry, [46]. 

There are other interesting and related questions, problems, and directions. In 
particular we would like to mention the analytic continuation of the i?-invariant 
character of the highest weight representations, and the reproducing kernel of the 
Hardy space realization of this representation to a spherical distribution character 
(spherical function) of the generalized principal series representation that we started 
with. This connects the representations that show up in the duality on the level of 
distribution characters. For this wc refer to [74, 54]. 

The paper is organized as follows. The list also includes some sources for 
additional background references: 

1. Some Spectral Considerations Related to Reflection Positivity [15, 84, 85] _ 4 



1.1. Unitary One- Parameter Groups and Path Space Integrals [1, 49] 4 

1.2. The {ax + 6)-Group [46, 88] 9 

1.3. The Hilbert Transform [13, 97] 10 

1.4. One-Parameter Groups 10 

2. The General Setting [46] 12 

3. Preliminaries [17, 89, 100, 61] 14 

4. A Basic Lemma [46] 15 

5. Holomorphic Representations [24, 25, 63, 75, 76] 18 

6. The Liischer-Mack Theorem [60] 21 

7. Bounded Symmetric Domains [31, 33, 26, 27] 23 
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8. Highest Weight Modules [10, 98, 64, 65, 12, 32, 38, 56] 25 

9. An Example: SU{1, 1) [46] 31 

10. Reflection Symmetry for Semisimple Symmetric Spaces [41, 42, 46, 95] 36 

11. The Segal-Bargmann Transform [78] 47 

12. The Heiscnberg Group [20, 43, 46] 50 

13. The {ax + 6)-Group Revisited [46, 59, 29] 60 
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1. Some Spectral Considerations Related to Reflection Positivity 

1.1. Unitary One-Parameter Groups and Path Space Integrals. The 

term reflection positivity is from quantum field theory (QFT) where it refers to a 
certain reflection in the time- variable. As we explained in the introduction this 
reflection is also the one which makes the analytic continuation between the (New- 
tonian) group of rigid motions and the Poincare group of relativity. This is the 
approach to QFT of Osterwalder and Schrader [84, 85]. The approach implies a 
change of the inner product, and the new Hilbert space which carries a unitary 
representation tt of the Poincare group P4 results from the corresponding "old" one 
by passing to a subspace where the positivity (the so-called Osterwalder-Schrader 
positivity) is satisfied. An energy operator may then be associated with this "new" 
unitary representation tt of P4. This representation tt is "physical" in that the 
corresponding energy is positive. The basic connection between the two groups 
may further be understood from the corresponding quadratic forms on space-time 
{x,t), X = {xi,X2,X3), {x,t) h-* \\x\\'^ +t'^ with ||a;|]^ = x\+x\ + x\. The analytic 
continuation 1 1-^ it, i = ^/—T, turns this into the form ||a;||^ — t'^ of relativity. This 
same philosophy may also be used in an analytic continuation argument connect- 
ing Feynman measure with the Wiener measure on path space. This is important 
since the Wiener measure seems to be the most efflcient way of making precise 
the Feynman measure, which involves infinite "renormalizations" if given a literal 
interpretation. We refer to [17] and [67] for more details on this point. 

For the convenience of the reader we include here a simple instance of reflection 
positivity for a path space measure which will be needed later: Let T> = T> (K) = 

(R) denote the usual test functions on M, and the dual space V = V (R) of 
distributions. (We use the notation q (/), q G V, f e V.) Let Hq = —^A+^q^ — | 
be the harmonic oscillator Hamiltonian, and form H = Hq — Eq picking Eq siieh 
that H > and Hfl = for a ground state vector Then by [17] there is a 
unique path-space measure (po on V such that 

J q{t) #0 (g) = o, 
J ?(ii)(z(t2)#o(g) = ^e-l*^-*=l. 

One rigorous interpretation (see [67, 68]) is to view (q(t)) here as a stochastic 
process, i.e., a family of random variables indexed by t. Further, for each t > 0, 
and for each "even -|- linear" real potential V {q) , there is a unique measure on 
V such that 

di^t = Z-^ exp J V [q (s)) j dcj)Q {q) 
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with 

V{q{s)) ds\ d4>o{q). 

-t/2 

The consideration leading to the relation between the measures d4)Q and d^it is the 
Trotter approximation for the (analytically continued) semigroup, 

g-it(-iA+v) ^ j.^ /g(it/2n)Ag-(jt/n)\/\"^ 
n— »oo V / 

See [67] for more details on this point. When the operator (•••)" on the right-hand 
side is computed, we find the integral kernel 



) 



dx. 



n-l 



with 



and 



S{xo,...,x„,t) = 2X11^^-1 "^jI^ [nj ( ~ ) • 

The heuristic motivation for i^o and Ht is then the "action" <S approximating 
S{q) = lj\q{s)f ds- J\{q{s))ds 



via 



and 



A * 

q{tj)=Xj, = 



i/n 

If -t/2 <ti<t2<---<tn< i/2. then 



(1.1) (fl Aie-(*^-*i^^A2e-(*^-*=^^A3---A„J^J 

/((. 
n Ak {q (tk)) dut (?(•))• 

(The reader can find more details in [17].) Using further Minlos' theorem (see, e.g., 
[17] or [92]), it can be shown that there is a measure /i on V such that 

(1.2) ^lim j e*«(/) diit (g) = j e^'^f^ d/i {q) =: S (/) 
for all / S D. Since /x is a positive measure, we have 

(1.3) Y.T.^kCiS{fk-fi)>0 

k I 

for all ci, . . . , c„ e C, and all /i, ...,/„ e 2?. When combining (1.1) and (1.2), we 

note that this limit-measure /i then accounts for the time-ordered n-point functions 
which occur on the left-hand side in formula (1.1). This observation will be further 
used in the analysis of a corresponding stationary stochastic process X^, {q) = 
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q{t), which we proceed to analyze and review. But, more importantly, it can be 
checked from the construction that we also have the following reflection positivity: 
Let (6»/) (s) := / (-s), f eV, seR, and set 

r»+ = {/ G P I / real valued, / (s) = for s < 0} . 

Then 

(1-4) ^^c,Q5(0(/fe)-/O>O 

k I 

for all ci, . . . , c„ G C, and all /i, . . . , /„ G X>+. (A small technical point: In the 
use of Minlos' theorem it is often more convenient to use the duality iS iS' of 
tempered distributions, as opposed to the D <-> D' duality mentioned above. The 
reason for this is that the Hcrmite functions are in <S but not in V.) These concepts 
are covered in detail in [84, 85]. 

While our work here was centered on the role of reflection positivity for the 
structure of representations of non-compact Lie groups G, the basic concepts arc 
important even in the case when G = M (the real line). In that case, the data is as 
follows: 

• H: a complex Hilbcrt space (compare with (1.3)) 

• Kg: a closed subspace (compare with I?_|_) 

• {U (t) I t G M}: a unitary one-parameter group acting on H 

• J: H — > H: a period-2 unitary operator (compare with / i— > 9 {/)) satisfying 

(1.5) JU{t) = U{-t)J, 

(1.6) P^JPa > (compare with (1.4)), 

(1.7) PaU {t) Pa = U (t) Po for all t > 0, 

where Pq is the orthogonal projection of H onto Kq. 

• Define N := {ko G Kq | (fco | Jko) = 0}. 

To illustrate that the axiom system (1.5)-(1.7) is very restrictive, we note that 
it is not satisfied for the usual translation group on M. Specifically, let H = (R), 
and U {t) f {x) ^ f {x — t), / G L"^ (M), x,t gR. Since the subspaces Kq for which 
(1.7) hold are known by Beurhng's theorem, see [29] and [59], we see that we 
cannot have all three (1.5)-(1.7) in this example, unless Kq = N. If (1.7) holds, 
then either (case 1) Kq is invariant under all U {t), t G R, and then it consists of 
all functions whose Fourier transform is supported on some measurable subset of 
R (depending on Kq), or else (case 2) it consists of the transforms of functions in 
qH-^ (R) where g is a unitary function and H'^ (M) is the usual Hardy space. Hence 
we may assume that J is given by 

where / is the Fourier transform. It is then easy to check in case 1 that we cannot 
have (1.6), and that in case 2, N = Kq. 

The simplest instance of (1.5)-(1.7) arises in quantum field theory and for 
certain stochastic processes; sec, e.g., [1, Lecture 4], [47]. Let {Xf | t G M} be a 
stationary stochastic process on a probability space {fl, P) which is symmetric in 
the sense that X_t has the same distribution as does Xj. In that case H = (Q, P) 
and Ko may be taken to be the subspace in (f2, P) generated by the functions 
which are measurable with respect to the a-field generated by {Xj | t > 0}, and Pq 
may be taken to be the corresponding conditional expectation. Since the process is 
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stationary, it generates a unitary one-parameter group in L"^ {Q,P), and the choice 
of Pq makes it clear that (1.5) and (1.7) will be satisfied. Condition (1.6) is an 
extra condition, which is called Osterwalder-Schrader positivity (or O-S positivity, 
for short), although the O-S positivity concept was first formulated in a different 
context; sec, e.g., [84, 85, Axioms 1-2]. 

Both in the case of unitary one-parameter groups and in the general context 
of representations of Lie groups, there is an operator- theoretic step used in passing 
from H to the new Hilbert space. It underlies two technical points involved in the 
construction: positivity and norm- estimates. It is given in Section 4 and referred 
to as the Basic Lemma. More details are in [46]. 

An application of our Basic Lemma, Section 4, produces a contraction W, 

Ko/N 

quotient y ^completion 
Ko ^ (Ko/N)'- 

such that {U (t) \ t > 0} is realized in H_|_ := (Ko/N)~ as a contractive and self- 
adjoint semigroup {U (t) \ t>Q}, and 

(1.9) WU it) |ko = U{t)W, t> 0. 

Since this induced semigroup is contractive and selfadjoint, it can be shown to have 
the form 

(1.10) U{t) = e-*", t>0 

for a selfadjoint operator H , H > 0, H acting in H+. The semigroup U (t) in 

(1.10) is constructed here by a procedure which is also applicable to a large class of 
non-compact Lie groups. In the present case, the idea is simple: Prom the axioms 
(1.5)-(1.7), we get 

(1.11) {ko\JU{t)ko) < {ko\Jko) , for fco e Kq and for alH > 0. 

Hence N := {fco G Kg | (fco | Jfco) = 0} is invariant under {U (t) \ t> 0} which then 
passes to the quotient Kq/N as a contraction semigroup on the completed Hilbert 
space. The selfadjointness of the induced semigroup follows from the identity 

(1.12) (ki I JU (t) fez) - {U (t) ki I Jfca) , 

valid for all fei, fez € Kq, and t > 0. The proof of (1-12) in turn is immediate from 
axiom (1.5). 

When applied to the stochastic process example, we get a concrete realization 
of this semigroup U (t) = e~*^ on H+. In pure operator-theoretic terms, what 
results is the following data: 

(i) Ko and H+, two Hilbert spaces; 

(ii) {V (i)}t>o, a semigroup of isometrics in Ko; 

(iii) H > 0, a, selfadjoint, generally unbounded operator, in H4.; 

(iv) W: Ko H+, a contractive linear operator which has the following prop- 
erties: ker (T4^) = 0; and kcr(W*) = 0, i.e., the range of W is dense, which 
is to say, W (Ko) is dense in H_|_ relative to the norm of H_|_; 

(v) W intertwines the semigroups in the respective spaces, i.e., 

e-^"W = WV (t) , for all t > 0. 



(1.8) 
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Note that the properties hsted in (iv) for W imply that the polar decomposition 

W = Wo {W*W)^^'^ has the partial isometric factor Wo : Kq H+ a unitary 
isomorphism, but, of course, Wq will not intertwine e~*^ and {V^(i)}t>o> ^■^■■> 
relation in (v) does not pass to the polar decomposition. 

It is this realization which wc call the 0-S construction. Since the constant 
function 1 € (fi, P) is cyclic for the L°° (il)-multiplication algebra acting on 
{^l,P), we get n := W (1) G H+ satisfying a similar cyclicity property in H_|_ 
and also U {t)fl = fl for alH > 0, or equivalently, O is in the domain of H, and 
HQ = 0. 

If (17, P), {U (t)} are constructed from a stationary stochastic process as 
described, then we may get (1.6) satisfied if 

(1.13) / /ioXt,/2oXt, ••• /„oXt„dP>0 for all /!,...,/„ eCe(M), 
Jn 

and all ti, . . . , f„ e M such that — oo < ti < t2 < ■ ■ ■ < tn < oo. 

Moreover, condition (1.13) is alternately denoted the Osterwalder-Schradcr posi- 
tivity condition. It can be obtained if instead we start with a semigroup {U (t) , H) 
and a representation / i— > tt (/) of Cc (R) on H such that, for a vector w e H, we 
have 

(1.14) {V I TT (/i) U {t2 - h) n (/2) U{t3-t2)---U {tn - i„-l) TT (/„) v) 

for all fi, ■ ■ ■ , fn & Cc (IR) , and — oo < < f2 oo. 

Starting with one of the two, (1.13) or (1.14), the other can be constructed such 
that the expressions in (1.13) and (1.14) arc equal. This is the content of the 0-S 
construction in the formulation of E. Nelson and others [68, 48]. 

To understand (1.9) better, it is useful to compare it to the Nagy dilation of a 
semigroup; see [101]. The Nagy theorem states that every contraction semigroup 
{U {t) , H, f > 0) admits a representation {U (t) , H, f € M) where H C H, and U {t) 
is a one-parameter unitary group in H which satisfies 

(1.15) P^U{t)\fy = Uit), t>0. 

While there are some generalizations of (1-15) to (non-abelian) Lie groups, e.g.. 
[45], the relation (1.9) is the focus of the present paper, wherein wc show that it 
characterizes a class of "physical" representations of semisimple non-compact Lie 
groups. In (1.15), Pjj denotes the orthogonal projection of H onto H. Hence (1.15) 
may be rephrased in terms of an isometry V: H — > H, and we get 

(1.16) V*U{t)V = U{t), t>0. 

In case the stochastic process (Xj, t e M) is given on path space X^ (w) = co{t), 
Arveson found (in [1, Proposition 4.6]) a reformulation of (1.9) much in the spirit of 
(1.16), but Arveson produces a simultaneous "dilation" of a given semigroup and a 
representation of Cc (R). First consider the following two representations of Cc (K): 

• a representing Cc (M) on (O, P) given by 
(L17) a(/)F(a;) = /(a;(0))P(a;), 

for feCc (K), FeL'^ {n, P), and 
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• M representing Cc (K) on H by 

(1.18) {Mfh){t) = f{t)h{t), 

for/eCcW, /leH. 
Let V be the vector in (1.14). Arveson then shows that the linear mapping 

(1.19) Mfv\ — >(7(/)l 
extends uniquely to an isometry 

V: (R) — ^ {n,P) 

which satisfies 

(1.20) V*U ih) a (/i) U {t2) <j{h)---U (<„) a (/„) V 

= U (h) Mf,U{t2) Mf,---U {tn) Mf^ 

for alln=l,2,...,ti€R,ti> 0, and all fi G Cc (K). 

The space (R) is thereby identified as a closed subspace in L'^ {fl,P). It is 
the time-zero subspace, and is "much smaller" than the subspace generated by the 
cr-algebra of (Xj, i > 0). There is a selfadjoint semigroup induced from both of the 
subspaces. In general, it is the t = semigroup which has the Markoff property in 
the sense of Nelson [68, Theorem 1] . 

1.2. The {ax + &)-Group. The general case breaks down into the analysis 
of the solvable case, and the semisimple case. Therefore it is appropriate to start 
with the 2-dimensional solvable case, that is the {ax + 6)-group. We may realize 
this group G as the afRne transformations ax + 6 of R, a E R_|- , 6 G R. Hence up 
to a trivial scale, the Lie algebra is determined by the relation [A, B] = B. Let 
r(a, h) = {a, —b). A unitary representation of G on a Hilbert space H is therefore 
specified by two unitary one-parameter groups Ua (s), Ub {t), s,t gM., satisfying 

(1.21) Ua {s) Ub {t) Ua (-s) - Ub (e^ • t) . 

The spectra of the two groups form subsets of R, and (1.21) shows that the spectrum 
A {B) = spec {Ub) is invariant under positive dilations, that is 

(1.22) R+ • A(B) = A(B). 

But (1.22) implies that either A {B) = R+, A {B) = R_, or A {B) = R. 
Based on these considerations, we have the following: 

Theorem 1.1. There are no nontrivial reflection symmetries for infinite di- 
mensional unitary representations of the {ax + h) group. 

Proof (sketch). It is enough to exclude the reflection which sends A ^ A, 
and B ^ —B. We must show that in every Kq C H which is invariant under 
{Ua (s) I s G R} and under {Ub {t)\t> 0}, and for every (J,Ko) such that (1.6) 
holds, and JUa (s) = Ua (s) J and JUb {t) = Ub {—t) J, we must have H (= 
(Ko/N)'^) the trivial zero- dimensional space. 

Recalling the new norm in H, / i-^- (/ | J f) = ||/||^, and 

N = {/GKo|(/|J/) = 0}, 
we conclude that the induced transformations Ua and Ub on H satisfy: 

(i) Ua is a unitary one-parameter group on H and its spectrum is a subset of 
A (A); 
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(ii) {?7b (t) I t > 0} is a contraction semigroup on H satisfying IJb (i)* = Ub {t); 
and 

(iii) Ua (.s) Ub (t) Ua {~s) = Ub (e" • t) for all s e M, and t > 0. 

Combining (ii)-(iii), and using a theorem of [88], we may assume that the selfadjoint 
generator Hb of Ub {t) (= e'*^^ ) and J have the representation 



^0 -HJ' \I 

relative to H = ^jj^^ closed subspaces H±. In this representation it is possible 

to check all the candidates for Kq C H with the stated properties; see also Sections 
3 and 13 below. The presence of a nontrivial Kq leads to (1.23) and the conclusion 
that A {B) = R. But, of the nontrivial candidates for Kq, none can satisfy the 
added axioms 

PoJPo > 

and 

PoUb (t) Pa = Ub (t) Po, for all t > 0. 
We postpone further details to a future paper on semidirect products. □ 

We refer to Section 13 for more detailed discussion on the {ax + 6)-group. 

1.3. The Hilbert Transform. In a recent paper [97], Segal obtains a positive 

energy representation of the Poincarc group P on a Hilbert space of "complex" 
spinors. The construction is a renormalization of the usual Klein-Gordon inner 
product, by use of an operator J much like the one described above. In Fourier 
variables, it is J: (fc) i9 (fc) (f) (fc), where k = {ko, ki,k2, fcs) denotes a point in 
momentum space, and 



•(fc) 



+1 if fco > 0, 
-1 if fco < 0. 



Hence J appears as the Hilbert transform with respect to time. One of the corollar- 
ies of our results in Section 7 is that, even in the general case of reflection positivity 
for semisimplc Lie groups, the appropriate J must indeed be a generalized Hilbert 
transform, and the construction is tied to the complementary series. 



1.4. One-Parameter Groups. In addition to the examples from path-space 
measures, there are those which arise directly from the theory of representations 
of reductive Lie groups. While this applies completely generally, the SL(2,M.) ~ 
SU(l, 1) case is worked out in detail in Section 9 below. When the representations 
there are restricted to a suitable one-parameter subgroup in SL{2, R), we arrive at 
the following basic setup for the axiom system (1.5)-(1.7). 

Let < s < 1 be given. Let H := H(s) be the Hilbert space given by the norm 
squared 

11/11^:= / / f {x)f {y)\x-y\^~'^ dxdy <oo. 
Js. Jm. 
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With s fixed, let Kq C H be the subspace of functions in H which have compact 
support in (—1, 1). Let {U {t)}^^^ be the unitary one-parameter group given by 

(1.24) U,{t)f{x)=e^'+'^*f{e'''x). 

It follows from representation theory (see Section 9) that, for every s G (0, 1), the 
spectrum of the group [/«(•) in (1.24) is continuous and is all of R. 
Let J : H ^ H be given by 

jf{x)^\xr~'f{i/x) . 

Then an elementary calculation shows that the axioms (1.5)-(1.7) are satisfied when 
Po denotes the projection onto Kq. We will then form the completion of Kq relative 
to the norm || • llij^j;^-) given by 

(1-25) ll/ll^) = (./l^./W) , 

for / G Kq. While we are completing a space of functions, it turns out that the 
elements in the completion are generally distributions which may not be functions. 

Wc stress this example since it is the simplest instance when the completion 
(1.8) is made explicit as a concrete space of distributions. It follows from the 
representation-theoretic setup (Section 9) that 

H+ = (Ko/N)- 

is then the Hilbert space of distributions obtained from completion of measurable 
functions on (—1, 1) completed relative to the new norm squared from (1.25), viz., 

(1-26) J J J{x)f{y)\l-xyr' dxdy<^. 

The fact that H+(s), for < s < 1, is a space of distributions is significant for 
the spectral theory. The Dirac delta "function" S is in H+(,s) and is a ground state 
vector. When the unitary one-parameter group (1.24) is passed to H+(s), we get 
(for each s) the positive selfadjoint generator H — Hg from (1.10), and we check 
that H5 = {1 — s)S with 1 — s =the bottom of the spectrum of H. It is true in fact 
that the full spectrum of H in H+(s) is {2n + 1 — s | n = 0, 1, 2, . . . }, and that the 
spectrum is simple. 

It can be shown that H+(s), for < s < 1, from (1.25) (1.26) in fact are 
associated with measures on M as follows. The assertion is that, for every / e 

h7(^), 

C,(-i,i)9^^(/|^)^^ eC 

extends to a Radon measure, 

M/ if)= (x) duf (x) , 

JR 

on R. To see this, use the estimates 

(1-27) |(/I^)h:;:(7)|<II/IIh:;:(7)IMIh:;^^ 
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and 

(1.28) ll^llg-- < const X sup \<p{x)\ , V^eCe(-l,l). 

+ ^ ' xe(-i,i) 

We will study the Hilbert spaces H(s) and H+(s) further in Section 9 below, 
where we show among other things that {(rf/dx)" (5 | n = 0, 1, 2, . . . } forms an or- 
thogonal basis in the reflection Hilbert space H_|_(s) for all s G (0, 1). This is a way 
to turn the Taylor expansion into an orthogonal decomposition. 

2. The General Setting 

The setup is a connected Lie group G with an nontrivial involution, that is a 
symmetry, t: G G. The differential r : g ^ g is then an involution on the Lie 
algebra & of G. Let H := G^ = {x e G \ r(x) = x} and t) ■= {X e 2 \ t{X) = X}. 
Then f) is the Lie algebra of H. Let q := {X G g | t{X) = —X}. Then q is a vector 
space isomorphic to the tangent space Tx^{G/H), where Xo = eH € G/H. 

The c-dual of (fl, r) is defined to be the Lie algebra 

:= [) + i(\ C Qc 

with the involution t'^ := t\q'^. We let G'^ be the simply connected Lie group 
with the Lie algebra g*^. Then r integrates to an involution t": G^ — > G'^, and 
H'^ {G'^Y is connected, [70]. Here are few examples of triples {G,G'^,t): 

1. Compact Lie groups: Let G be a compact Lie group. Then G'' is a simply 
connected reductive Lie group with Cartan involution t'^, and every connected 
simply connected reductive Lie group can be constructed in this way. 

2. The group case: Let ff be a Lie group and let G = H x H. We identify 
H with the diagonal d{H) = {{a, a) e G | a e H}. Define T{a,b) := {b,a). Then 
G'" = H. Furthermore the map 

G/H 3 {a, h)H I — > ab-^ e H 

is a diffeomorphism, intertwining the canonical action of G on G/H and the action 
(a, b) ■ X = axb~^ on H. Denote the simply connected complex Lie group with the 
Lie algebra l)c by He. Then G'^ = He, and is the conjugation with respect to the 
real form [). Hence the analysis on Lie groups and their complexification is a special 
case of symmetric space duality. The case He = SL{2n, C) and H = SU (n, n) was 
treated by R. Schrader in [95]. 

3. Semidirect product with abelian normal subgroup: Let G = QH 
with Q and H connected, Q normal subgroup of G and QC\H = {e}. Then we can 
define an involution on G by 

T{qh) := q~^h . 

Thus q is the Lie algebra of Q. Define g —^ hy 

^X + Y) —iX + Y , XGq,YGl). 

Then $ is a Lie algebra isomorphism. Thus G'^ is the simply connected covering 
group of G. A special case hereof is the {ax + 6)-group and the Heisenberg group, 
where H is also abelian. 

4. The {ax + 6)-group: The {ax + 6)-group is the group of transformations 
X 1-^ ax + b, a > 0, 6 e M. We take Q = R and H = K+. Then r is given by 
T{a,b) = {a,-b). 
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5. The Heisenberg group: Let i?„ be the {2n + l)-dimensional Heisenberg 
group. We write 

r / 1 X* z \ 

Hn= lh{x,y,z)= I In-i y x,yGR",2G 

I V 1 J 

with multiphcation given by 

h{x, y, z)h{x', y', z') = /i(x + x', y + y', z + z' + {x\ y')) • 

In particular h{x,y,z)^^ = x, — y, (x | y) — z). In this case we take H = 
{/i(x,0,0)} ~ R", which is abcUan, and Q = {h{0,y,z) e if„ | y e R", ^ e M} ~ 
]^n+i^ The involution is given by 

T{h{x, y, z)) h{x, -y, -z) . 

Starting from the pair (G,t) and a unitary representation (7r,H(7r)) of G we 
need a compactible involution on the Hilbert space H(7r), that is a unitary linear 
map J: H(7r) — > H(7r) intertwining tt and wot. Thus 

Jw{g) = w{T{g))J yg€G. 

Wc will also need a semigroup S such that C S* or at least H C S where the 
bar denotes topological closure. We shall consider closed subspaces Kq C H(7r), 
where H(7r) is the Hilbert space of tt, such that Kq is invariant under 7r(5'''). Let 
J: H(7r) — > H(7r) be a unitary intertwining operator for tt and tt o t such that 
= id. We assume that Kq may be chosen such that WvWj := {v \ Jv) > for 
all V G Kq. We will always assume our inner product conjugate linear in the first 
argument. We form, in the usual way, the Hilbert space K = (Kq/N)"^ by dividing 
out with N = {t; e Kq | {v \ Jv) = 0} and completing in the norm || • || j. (This is 
of course a variation of the Gelfand-Naimark-Segal (GNS) construction.) With the 
properties of (G, tt, H(7r), K) as stated, we show, using the Liischcr-Mack theorem, 
that the simply connected Lie group with Lie algebra q'^ = ()©iq carries a unitary 
representation it" on K such that {'jT''{hexp{iY)) \ h G H,Y G C"} is obtained from 
TT by passing the corresponding operators TT{hc'xpY) to the quotient Kg/N. To see 
that this leads to a unitary representation tTc of we use a basic result of Liischer 
and Mack [60] and in a more general context one of Jorgensen [41]. In fact, when 
Y E C, the selfadjoint operator dTT{Y) on K has spectrum contained in (— oo, 0]. As 
in Lemma 4.5, we show that in the case where C extends to an G"^ invariant regular 
cone in ig^ = if) ® q and is injective, then each (as a unitary representation of 
G") must be a direct integral of highest-weight representations of C^. The examples 
show that one can relax the condition in different ways, that is one can avoid using 
the Liischer-Mack theorem by instead constructing local representations and using 
only cones that are neither generating nor iJ-invariant. 

Assume now that G is a semidirect product of H and N with N normal and 
abelian. Define r: G — > G by T{hn) = hn~^. Let n G H (the unitary dual) and 
extend tt to a unitary representation of G by setting TT{hn) = 7r(/i). In this case, G"^ 
is locally isomorphic to G, and tt gives rise to a unitary representation n'^ of G^ by 
the formula d'jT''{X) = d7r(X), X G I), and dTr%q = 0. A special case of this is the 
3-dimensional Heisenberg group, and the (ax + 6)-group. In Sections 12 and 13, we 
show that, if we induce instead a character of the subgroup N to G, then we have 
(Ko/N)~ = {0}. 
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Our approach to the general representation correspondence tt tt'^ is related to 
the intcgrabiUty problem for representations of Lie groups (see [44]): bnt the present 
positivity viewpoint comes from Osterwalder-Schrader positivity; see [84, 85]. In 
addition the following other papers are relevant in this connection: [15, 41, 42, 
50, 91, 95]. 

3. Preliminaries 

The setting for the paper is a general Lie group G with a nontrivial involutive 
automorphism r. 

Definition 3.1. A unitary representation tt acting on a Hilbert space H(7r) is 
said to be reflection symmetric if there is a unitary operator J: H(7r) — > H(7r) such 

that 

Rl) J2 id; 

R2) Mg) = TT{T{g))J , g e G. 

If (Rl) holds, then tt and nor are equivalent. Furthermore, generally from (R2) 
we have J^TT{g) = 77(5) J^. Thus, if tt is irreducible, then we can always renormalize 
J such that (Rl) holds. Let H = G'^ = {g E G \ T(g) = g} and let f) be the Lie 
algebra of H. Then f) = {X G g ] t{X) = X}. Define q = {F e g ] r(V) = -Y}. 
Then Q = ^®c\, [f), q] C q and [q, q] C \). 

Definition 3.2. A closed convex cone C C q is hyperbolic if C° ^ and if 
adX is semisimple with real eigenvalues for every X &C°. 

We will assume the following for (G, tt, t, J): 

PRl) TT is reflection symmetric with reflection J; 

PR2) there is an iJ-invariant hyperbolic cone C C q such that S{G) = HexpG 
is a closed semigroup and S{G)° = HcxpG° is diffeomorphic to H x G°; 

PR3) there is a subspace ^ Kq C H(7r) invariant under S{G) satisfying the 
positivity condition 

{v\v)j:={v\J{v))>0, Vt)GKo. 

Remark 3.3. In (PR3) we can always assume that Kq is closed, as the in- 
variance and the positivity pass over to the closure. In (PR2) it is only necessary 
to assume that Kq is invariant under exp C, as one can always replace Kg by 
(7r(i?)Ko), the closed space generated by 7r(ff)Ko, which is S'(C)-invariant, as C is 
if-invariant. For the exact conditions on the cone for (PR2) to hold see the original 
paper by J. Lawson [58], or the monograph [31, pp. 194 ff.]. 

In some of the examples we will replace (PR2)and (PR3) by the following: 

weaker conditions 

PR2') G is (merely) some nontrivial cone in q. 

PR3') There is a subspace ^ Kq C H(7r) invariant under H and exp C satisfying 
the positivity condition from (PR3). 

(See Section 12 for further details.) 
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Since the operators {TT{h) \ h G H} commute with J, they clearly pass to the 
quotient by 

N := {w e Ko I (w I Jv) = 0} 

and implement unitary operators on K := (Ko/N)" relative to the inner product 
induced by 

(3.1) {u\v)j:={u\J{v)} . 

which will be denoted by the same symbol. Hence we shall be concerned with 
passing the operators {7r(expy) \ Y G C} to the quotient Kq/N, and for this we 
need a basic Lemma. 

In general, when (Kq, J) is given, satisfying the positivity axiom, then the 
corresponding composite quotient mapping 

Ko Ko/N (Ko/N)~ =: K 

is contractive relative to the respective Hilbert norms. The resulting (contractive) 
mapping will be denoted f3. An operator 7 on H which leaves Kq invariant is said 
to induce the operator 7onKif/3o7 = 7o/3 holds on Kq. In general, an induced 
operation 71-^7 may not exist; and, if it does, 7 may fail to be bounded, even if 7 
is bounded. 

This above-mentioned operator-theoretic formulation of reflection positivity has 
applications to the Fcynman-Kac formula in mathematical physics, and there is 
a considerable literature on that subject, with work by E. Nelson [67, 68], A. 
Klein and L.J. Landau [47, 48, 49], B. Simon, and W.B. Arveson [1]. Since 
we shall not use path space measures here, we will omit those applications, and 
instead refer the reader to the survey paper [1] (lecture 4) by W.B. Arveson. In 
addition to mathematical physics, our motivation also derives from recent papers 
on non-commutative harmonic analysis which explore analytic continuation of the 
underlying representations; see, e.g., [34, 54, 63, 72, 73, 80]. 



4. A Basic Lemma 

Lemma 4.1. 1) Let J be a period-2 unitary operator on a Hilbert space H, 
and let Kq C H 6e a closed subspace such that {v \ J{v)) > 0, v G Kq. Let 
7 be an invertible operator on H such that J7 = J~^J and which leaves 
Kq invariant and has (7~^)*7 bounded on H. Then 7 induces a bounded 
operator 7 on K = (Kq/N)'^, where N = {v G Kq j {v \ Jv) = 0}, and the 
norm of 7 relative to the J -inner product in K satisfies 

(4.1) Il7ll< 11(7-^711^/', 

where \\ ■ \\gp is the spectral radius. 
2) If we have a semigroup S of operators on H satisfying the conditions in (1), 
then 



(4.2) 



(7172)" = 7172 , 71) 72 e 5 . 
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Proof. For v e Kq, v y^O, we have 

ll7Mfy = (7W|J7W> 



< ll(7-')*7MI|7||^^||j 



<ii((7-^)*7)^"Miiy^"ib.ii^/^/^+-+^/^" 

< (ll((7"^)*7)^ IllkllV'" Ik"' 



(ll((7-')*7)' 



J ■ 



Since lim ||((7-^)*7)2''||i/2" = ||(7-i)*7||^p, and lim = 1, the result fol- 

n — ^oo n — ^oo 

lows. 

By this we get 

{7{v)\Jl{v))<\\il-'ri\\sp {V\J{V)) 

which shows that 7(N) c N, whence 7 passes to a bounded operator on the quotient 
Kq/N and then also on K satisfying the estimate stated in (1). If both the operators 
in (4.2) leave N invariant, so does 7172 and the operator induced by 7172 is 7172 
as stated. □ 

Corollary 4.2. Let the notation be as above and assume that 7 is unitary on 
H. Then the constant on the right in (4.1) is one. Hence j is a contraction on K. 

To understand the assumptions on the space Kq, that is positivity and invari- 
ance, we include the following which is based on an idea of R.S. Phillips [89]. 

Proposition 4.3. Let H be a Hilbert space and let J be a period-2 unitary 
operator on H. Let S be a commutative semigroup of unitary operators on H such 
that S = S+S- with S+ = {j G S \ Jj = 7J} and 5_ = {7 e 5 | J7 = 7"^}. 
Then H possesses a maximal positive and invariant subspace, that is a subspace Kq 
such that {v \ J{v)) > 0, u G Ko, and 7K0 C Kq, 7 G S*. 

Proof. The basic idea is contained in [89, pp. 386 ff.]. □ 

Remark 4.4. A nice application is to the case H = L^ {X, m) where X is a 
Stone space. There is a m-a.e.-defined automorphism 9: X ^ X such that 

J{f)=f°0, feL^X,m) 

and S is represented by multiplication operators on {X,m). By [89] we know 
that there are clopen subsets A,BcX such that with Mq := {x G X \ 6 (x) = x} 
and Ml = X \ Mo we have A,B c Mi, An B = 0, Au B = Mi and {A) = B. 
Let Ko := L^ (Mo U A). Then Kq is a maximal positive and invariant subspace. 

Lemma 4.5. If Mq C X is of measure zero, then the space K is trivial, that is 
{f\J{f))=Ofor allfeKo. 
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Remark 4.6. Assume that we have (PRl) and (PR2). By [55] there is an 
abelian subspace acq such that C° = Ad{H){C'° n a). Let Sa = cxp(C° n a). 
Then Sa is an abelian semigroup, so one can use Proposition 4.3 to construct a 
maximal positive and invariant subspace for Sa- But in general we can not expect 
this space to be invariant under S. 

We read off from the basic Lemma the following Proposition: 

Proposition 4.7. Let n be a unitary representation of the group G. Assume 
that (r, J,C,Ko) satisfies the conditions (PRl), (PR2'), and (PR3'). IfY G C, 
then 7r(expF) induces a contractive self adjoint operator TT{expY) on K. 

Proof. If F e C, then 7r(expF)Ko C Kq, and 7r(expF) is unitary on H(7r). 
Thus 

{Tr{expY)u\J{v)) = (w 1 7r(exp(-Y-)) J(?;)) 
= (u I J(7r(expy)u)) , 

proving that 7r(expF) is selfadjoint in the J-inner product. Since 7r(expy) is 
unitary on H(7r) 

||7r(expF)|| = ||7r(expy)||sp = 1, 
and the contractivity property follows. □ 

Lemma 4.8. Let tt be a unitary representation of G such that (r, J, C, Kq) sat- 
isfies the conditions (PRl), (PR2'), and (PR3'). Then for Y G C there is a selfad- 
joint operator dTr{Y) in K = (Ko/N)~, with spectrum contained in (— oo,0], such 
that 

^(exp(iy)) = e*''*(^\ ieM+ 

is a, contractive semigroup on K. Furthermore the following hold: 

1) t 1-^ gt<i7r(y) extends to a continuous map z i— > e^'^'^^^^ on {z € C \ Re(^) > 
0} holomorphic on the open right half-plane, and such that gi^+i^) dv{Y) _ 

2) There exists a one-parameter group of unitary operators 

7r(exp(iiy)) :=e"'^*(^), ieM 

on K. 

Proof. The last statement follows by the spectral theorem. By construction 
{fr{cxp{tY)) I t G M+} is a semigroup of selfadjoint contractive operators on K. 
The existence of the operators dTr{Y) as stated then follows from a general result 
in operator theory; sec, e.g., [14] or [49]. □ 

Corollary 4.9. Let the situation be as in the last corollary. IfYGGn —G 
then e*''*(^) = id for all teR+. In particular diriY) = for every K S C fl —C. 

Proof. This follows as the spectrum of diHY) and dTT{—Y) is contained in 
(-00,0]. □ 

We remark here that we have introduced the map d-K without using the space 
of smooth vectors for the representation tt. Let us recall that a vector v G H(7r) is 
called smooth if the map 

M 9 i I — > w{t) := 7r(expiX)v G H(7r) 
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is smooth for all X Q g. The vector is analytic if the above map is analytic. We 

denote by H°° (tt) the space of smooth vectors and by H'^ (tt) the space of analytic 
vectors. Both H"(7r) and H°°(7r) are G- invariant dense subspaces of H(7r). We 
define a representation of g on H°° (tt) by 

d,(X)v = lim "(^^P^^)w . 

^ ^ t^o t 

Recall that if tt is infinite-dimensional, then dn is a representation of g by 
unbounded operator on H(7r), but the analytic vectors and the (7°°-vectors form 
dense domains for dn; see [66, 90, 103]. 

The operator dTt{X) in the above statements is an extension of the operator 
dTT{X) on the space of smooth vectors. This allows us to use the same notation for 
those two objects. We extend this representation to gc by complex linearity, d'K{X+ 
iY) = dTT{X) + i d7r{Y), X,Y £ g. Let U (g) denote the universal enveloping algebra 
of gc- Then dw extends to a representation on U (g), again denoted by dw. The space 
H°°(7r) is a topological vector space in a natural way, cf. [103]. Furthermore H°°(7r) 
is invariant under G and U{g). As Tr{g)'K{exp{tX))v = Tr{exp{t Ad{g)X))'K{g)v, we 
get 

7r(g) dTr{X)v = d7r( Ad(5)X)7r(ff )v, v e H°° (tt) 

for all 5f e G and all X e g. Define Z* = —a{Z), Z G gc, where a is the conjugation 
X + iY 1-^ X — iY, X,Y E g. Then a simple calculation shows that for the densely 
defined operator 7t{Z), Z e gc, we have Tr{Z)* = tt{Z*) on H°°(7r). 

When (Rl-2) and (PRl-3) hold, and F e G, we showed in Lemma 4.8 that the 
operator tt{Y) is sclfadjoint in K = (Kq/N)"" with spectrum in [0,oo). Once tt is 
identified as a unitary representation of G'^, then tt {iY) is automatically a sclfad- 
joint operator in K by [69] , but semiboundedness of the corresponding spectrum of 
TT {Y) only holds for Y E C . Yet if tt is obtained, as in Lemma 4.8, from a unitary 
representation tt of G acting on H, then the spectrum of tt (Y) is contained in the 
purely imaginary axis iR, and yet tt (Y) has spectrum in [0, oo) C K. The explana- 
tion is that the Hilbert spaces H and K are different for the two representations tt 
and TT. 

5. Holomorphic Representations 

The unitary representations that show up in the duality arc direct integrals of 
highest weight G'^-modules. Those representations can also be viewed as holomor- 
phic representations of a semigroup related to an extension of the i?-invariant cone 
G that we started with. We will therefore give a short overview over this theory, 
while referring to the forthcoming monograph [65] for more details. 

The theory of highest weight modules and holomorphic representations will al- 
ways be related to the name of Harish-Chandra because of his fundamental work 
on bounded symmetric domains and the holomorphic discrete series, [21, 22, 23]. 
Later Gelfand and Gindikin in [16] proposed a new approach for studying the 
Plancherel formula for semisimple Lie group G. Their idea was to consider func- 
tions in (G) as the sum of boundary values of holomorphic functions defined on 
domains in Gc. The first deep results in this direction are due to Ol'shanskii [80] 
and Stanton [98], who realized the holomorphic discrete series of the group G in a 
Hardy space of a local tube domain containing G in the boundary. The generaliza- 
tion to noncompactly causal symmetric spaces was carried out in [33, 34, 75, 76] . 
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This program was carried out for solvable groups in [32] and for general groups in 
[53, 63]. 

Let Gc be a complex Lie group with Lie algebra Qc and let be a real form of 
0c- We assume for simplicity that G, the analytic subgroup of Gc with Lie algebra 

0, is closed in Gc- Let G be a regular G-invariant cone in g such that the set 
S{C) = GexpiC is a closed semigroup in Gc- Moreover, wc assume that the map 

GxC3 {a,X)< — > acxpiX e S{C) 

is a homeomorphism and even a diffeomorphism when restricted to G x G° . Finally, 
we assume that there exists a real automorphism a of Gc whose differential is 
the complex conjugation of gc with respect to g, that is (7{X + iY) = X — iY 
for X,Y £ Q. We notice that in this case Gc/G is a symmetric space and that 
the corresponding subspace q is just ig. Those hypotheses are also satisfied for 
Hermitian Lie groups and also for some solvable Lie groups; cf. [32]. Define 

(5.3) W{tt) :={Xeg\yue H°°(7r) : {i d-K{X)u | u) < 0} . 

Thus W{ii) is the set of (elements of g for which dn{iX) is negative. The elements 
of W{7:) arc called negative elements for the representation tt. 

Lemma 5.1. T'l'^(7r) is a elosed G-invariant convex cone in g. 

Definition 5.2. Let be a G-invariant cone in g. We denote the set of all 
unitary representations tt of G with W C W{Tr) by ^(M^). A unitary representation 
TT is called W -admissible if tt € ^(W^). 

The representations in ^(VF) will be studied in detail in Section 8 below. Wc 
show in Theorem 8.4 that a p € A{W) which is irreducible is in fact a highest weight 
representation, and the corresponding K'^-weights are determined. The representa- 
tions arc then identified as discrete summands in (G^). 

Let 5* be a semigroup with unit and let U: S" ^ 5* be a bijective involutive 
antihomomorphism, that is 

(06)" = b^a^ and a"" = a 

We call an involution on the semigroup S, and we call the pair {S, tt) a semi- 
group with involution or an involutive semigroup. For us the important examples 
are the semigroups of the form 5(G) = HexpC with 7" = T{'y~^). Another 
class of examples consists of the contractive semigroups on a Hilbert space H. Let 
S'(H) = {T e B(H) I ||rj| < 1}. Denote by T* the adjoint of T with respect to the 
inner product on H. Then (S, *) is a semigroup with involution. 

Definition 5.3. Let {S, fl) be a topological semigroup with involution: then 
a semigroup homomorphism p: S ^ SCH.) is called a contractive representation 
of {S, tt) if pis^) = pig)* a-nd p is continuous with respect to the weak operator 
topology of S'(H). A contractive representation is called irreducible if there is no 
closed nontrivial subspace of H invariant under p{S). 

Definition 5.4. Let p be a contractive representation of the semigroup S{W) = 
GexpiW^ C Gc- Then p is holomorphic if the function p: S{C)° — > B(V) is holo- 

morphic. 

The following lemma shows that, if a unitary representation of the group G 
extends to a holomorphic representation of S{C), then this extension is unique. 
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Lemma 5.5. ///: S{W) 'S'(H) is continuous and flsiw)" holomorphic 
such that /|g = 0, then / = 0. 

To construct a holomorphic extension p of a representation tt we have to assume 
that TT e ^(Vt^). Then for any X e W, the operator i d7r(X) generates a self adjoint 
contraction semigroup which we denote by 

Txit) = e*''^''^^K 

For s = gexpiX e S{C) we define 

(5.4) p{s) := p{g)Tx{l) 

Theorem 5.6. p is a contractive and holomorphic representation of the semi- 
group S{W). In particular, every representation tt e extends uniquely to a 
holomorphic representation of S{W) which is uniquely determined by n. 

Wc will usually denote the holomorphic extension of the representation tt by the 
same letter. For the converse of Theorem 5.6, we remark the following simple fact: 
Let {S, tt) be a semigroup with involution and let p be a contractive representation 
of 5. Let 

G{S) :={seS\ sh = ss" = 1} 

Then G{S) is a closed subgroup of S and n := p\g{S) is a unitary representation of 
G{S). Obviously, 

GcG(S(W)). 

Thus every holomorphic representation of S(W) defines a unique unitary represen- 
tation of G by restriction. 

Theorem 5.7. Let p be a holomorphic representation of S{W). Then p\g S 
>l(M^) and the p agrees with the extension of p\g to S{W). 

Two representations p and tt of the semigroup S{W) are said to (be unitarily) 
equivalent if there exists a unitary isomorphism U : H(/9) H(7r) such that 

Up{s) = tt{s)U Vs G S{W) 

In particular, two contractive representations p and tt of S{W) are equivalent if 
and only if p|g and ttIg are unitarily equivalent. We call a holomorphic contractive 
representation p of S{W) W-admissible if /o|g € ^(W) and write p G A{W). 

Wc denote by S{W) the set of equivalence classes of irreducible holomorphic 
representations of S{W). 

We say that a representation p is bounded if ||/!>(s)|| < 1 for all s G S{W). 
Note that this depends only on the unitary equivalence class of p. We denote by 
S{W)i^ the subset in S{W) of bounded representations. Let p and tt be holomorphic 
representations of S{W). Define a representation of S{W) in H(p)(g)H(7r) by 

[p (g) 7r](s) := p{s) (g) 7r(s) 

Then p ® tt e ^(VK). We denote the representation s id by l. 

Theorem 5.8 (Neeb, Ol'shanskn [33, 63, 65]). Let p be a holomorphic repre- 
sentation of S{W)b- Then there exists a Borel measure p on S{W) supported on 
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S{W)i^ and a direct integral of representations 
( f® f® 



(r® r® 
I Pu;dll{u}), / 



such that: 

(i) The representation p is equivalent to J^fTrp. Pu dp.{uj) . 

(ii) There exists a subset N C sfw^j, such that p.{N) = and ifw £ S(W)f,\N, 
then p^ is equivalent to {-k^^ ® t, H(t<;)®L(a;)), where tt^ G w and L(t<;) is a 
Hilbert space. 

(iii) If CO e S{W)f^ then setn{u)) := dimL(a;). Thenn is a ^-measurable function 

from S{W),^ to the extended positive axis [0, oo] which is called the multi- 
plicity function. 

Proof. See [65], Theorem XI.6.13. □ 
6. The Liischer-Mack Theorem 

Wc use reference [31] for the Liischer-Mack Theorem, but [15], [18], [41], [42], 
[44] , [50] , [60] , and [95] should also be mentioned in this connection. We have two 
ways of making the connection between the unitary representations of G and those 
of C: one is based on the Liischer-Mack principle, and the other on the notion of 
local representations from Jorgensen's papers [41] and [42]. 

Let TT, C, H(7r), J and Kq be as before. We have proved that the operators 

{7r(/iexp(F)) \h€H,Y€C} 

pass to the space K = (Ko/N)"^ such that Tt{h) is unitary on K, and 7r(expF) 
is contractive and selfadjoint on K. As a result we arrive at selfadjoint operators 
dTT{Y) with spectrum in (— oo,0] such that for Y G C, 7f(expF) = e'^'^^^^ on K. As 
a consequence of that we notice that 

extends to a continuous map on {2; e C | Re{z) > 0} holomorphic on the open right 
half plane {2; e C | Re(2:) > 0}. Furthermore, 

As K is a unitary if-module we know that the H-analytic vectors K'^ (H) are dense 
in K. Thus Koo := 5(C°)K"(i7) is dense in K. We notice that for u e Koo and 
X G C" the function t Tr{exptX)u extends to a holomorphic function on an open 
neighborhood of the right half-plane. This and the Campbell-Hausdorff formula are 
among the main tools used in proving the following Theorem of Liischer and Mack 
[60]. We refer to [31, p. 292] for the proof. Our present use of Lie theory, cones, 
and semigroups will follow standard conventions (see, e.g., [11, 26, 58, 103, 106]): 
the exponential mapping from the Lie algebra g to G is denoted exp, the adjoint 
representation of g, ad, and that of G is denoted Ad. 

Theorem 6.1 (Liischer-Mack [60]). Let p be a strongly continuous contractive 
representation of S{C) on the Hilbert space H such that p{s)* = p{t{s)~^). Let G^ 
be the connected, sim,ply connected, Lie group with Lie algebra q'^ ~ [) © iq. Then 
there exists a continuous unitary representation p'^: G'^ ^ U(H), extending p, such 
that for the differentiated representations dp and dp^ we have: 
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1) dp%x) = dp{x) \/x e f). 

2) dp^ltY) = idp{Y) VFeC. 

We apply this to our situation to get the following theorem: 

Theorem 6.2. Assume that (tt, C, H, J) satisfies (PR1)-(PR3). Then the fol- 
lowing hold: 

1) S{C) acts via s i-^ 7r(s) by contractions on K. 

2) Let C be the simply connected Lie group with Lie algebra g'^. Then there 
exists a unitary representation tt^ of G° such that dw'^{X) = dTr{X) for 
X Gt) andi dTf'={Y) = dniiY) for Y eC. 

3) The representation w'^ is irreducible if and only if fr is irreducible. 

Proof. (1) and (2) follow by the Liischer-Mack theorem and Proposition 3.6, 

as the resulting representation of S is obviously continuous. 

(3) Let L be a G^-invariant subspace in K. Then L is Tt{H) invariant. Let 
Y eC°,u€'L'^ and v e L-^. Define /: e C | Re(^;) > 0} ^ C by 



J 

Then / is holomorphic in {z G C \ Re{z) > 0}, and f{it) = for every (real) t. 
Thus / is identically zero. In particular f[t) = for every t > 0. Thus 







^tdir(Y)^^y^ = {vmex^ptY)u)j 



As S" = HexpC it follows that tt{S°){L'^) C (L^)^ = L. By continuity we get 
7r(S')L C L. Thus K is reducible as an 5-module. 

The other direction follows in exactly the same way. □ 

We notice now that —iC C W{tt'^). Thus W{7r'^) is non-trivial and contain 
the — T-stable and G-invariant cone generated by —iC, i.e. —i ■ conv{Ad(G)G} C 
W{'k'^). But in general W{Tf'^) is neither generating nor pointed. It even does not 
have to be — r-invariant. In fact, the Lie algebra of the {ax + 6)-group, and the 
Heiscnbcrg group, do not have any pointed, generating, invariant cones. 

Lemma 6.3. Win") n -Win") = kcrin"). 

Proof. This is obvious from the spectral theorem. □ 
Lemma 6.4. qI := W{Tr'^) — W{Tr'^) is an ideal in q'^. Furthermore, [q, q] ©iq C 

01- 

Proof. Let X e q'^. Then, as W{Tr'^) is invariant by construction, we conclude 

that 

By differentiation at i = 0, it follows that [X, g^] C gl- This shows that is an 
ideal in g"^. The last part follows as C is generating (in q). □ 

It is not clear if gj is r-stable. To get a r-stable subalgebra one can replace 
W{'k'^) by the cone generated by — Ad(G)G C W{'jT'^) or by the maximal G- and 

-r-stable cone Win") n (-r(T4^(^f=))) in W{tt''). 

We have now the following important consequence of the Neeb-Ol'shanskii the- 
orem: 
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Theorem 6.5. Let the analytic subgroup ofC corresponding to he as de- 
scribed, and let W{tt'^) he the corresponding module. Then tt'^Igj is a direct integral 
of irreducible representations in A{W). 

7. Bounded Symmetric Domains 

We have seen that the representations tt'^ that we can produce using the duahty 
are direct integrals of holomorphic representations of suitable subsemigroups of Gj. 
(or a subgroup) . Those on the other hand only exist if there is a invariant cone 
in Q. We will discuss the case of simple Lie group G"^ in some detail here. We refer 
to [46], chapter 2, and the references therein for proofs. In the duality G ^ it 
will be the group that has holomorphic representations. Therefore we will start 
using the notation G'^ for Hermitian groups. 

Theorem 7.1 (Kostant). Suppose that V is a finite- dimensional real vector 
space. Let L be a connected reductive subgroup of GL{y) acting irreducihly on 
V. Let = L' be the commutator subgroup of L. Further let K" be a maximal 
compact subgroup of G'^. Then the following properties are equivalent: 

(i) There exists a regular L-invariant closed cone in V. 

(ii) The G'^ -module V is spherical. 

Let G C V be a regular L-invariant cone. Then V is spherical as a G'^-module. 

Let K'^ be a maximal compact subgroup of G"^. A iiT ''-invariant vector can 
be constructed in the following way: Let m G G°, the interior of G, be arbitrary. 
Define 

Uif c = / k-udk . 

Then uk" & C° is iC'^-invariant. Suppose that the group L acts on V. Let 
ConeL (V) denote the set of regular i-invariant cones in V. 

Theorem 7.2 (Vinberg). Let L, G", and V be as in the theorem of Kostant. 
Then the following properties are equivalent: 

(i) ConeL(V) ^ 0; 

(ii) The G^-module V is spherical; 

(iii) There exists a ray in V through which is invariant with respect to some 
minimal parabolic subgroup P of G'^ . 

If those conditions hold, every invariant pointed cone in V is regular. 

For the next theorem, see [86, 87]. 

Theorem 7.3 (Paneitz, Vinberg). Let G'^ he a connected semisimple Lie group 
and (V,7r) a real finite- dimensional irreducible G'^-module such that ConeG=(V) ^ 
0. Let 9 be a Cartan involution on G'^. Choose an inner product on V such that 
7r{x)* = 7r{9{x)^^) for all x G G". Then there exists a unique up to multiplication 
by (—1) invariant cone Gmin € Coneac(V) given by 

Cmin = conv(7r(G^)u) U {0} = conv{7r(G^)(M+t;itc)} , 

where u is a highest weight vector, v^a is a nonzero K'^ -fixed vector unique up 
to scalar multiple, and {u,vk'=) > 0. The unique {up to multiplication by (— 1)) 
maximal cone is given by 

Cmax = G^„ := {«; e V I e G„,i„ : {w, v)>0} . 
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Assume now that C is a connected simple Lie group. Then acts on 

by the adjoint action. Let K''' C be a maximal almost compact subgroup. 
Then by Kostant's Theorem we have ConeGc(g'^) ^ if and only if there exists a 
Z'^ e which is invariant under Ad{K''). Let J*^ be the Lie algebra of K". Then 
[6'^, Z^] = 0. Hence RZ" + 1*^ 7^ is a Lie algebra containing f^. But is maximal 
in g'^. Hence Z° G f^. Similarly it follows that 3gc(Z°) = 6'=. Finally the Theorem 
of Paneitz and Vinberg implies that ConeG<:(fl'^) 7^ if and only if the center of 
is one dimensional, hi that case we can normalize the element Z*^ such that a,d(Z'^) 
has eigenvalues 0,i, —i. Let t be a Cartan subalgebra of g'^ containing Z'^. Then 
t'^C C r. Hence t is contained in r. For a e let 

flca := {X e fl£ I e tc : [Z,X] = a{Z)X} . 

It is well known that dim g^a ^ 1 fo'^ all a ^ and 

flc = tc ® flca 

where A = {a G \ {0} | ^ {0}}. We notice that a{i) C iR for all a e A as 
t C t and ad(X) is skew-symmetric for all X G 6. Let 0: g'^^g'^ be the Cartan 
involution corresponding to f^. We do denote the corresponding involution ^0 1 on 
flc and the integrated involution on G"^ by the same letter. Then g'^ = t'^Q)p'^ where 
pc={x e 0" I 0{X) = -X}. Thus g^c = t^® p^. Let Ac = {a G A I a{Z°) = O} 
and Ap = {a G A I a{Z°) = ±i}. As 3gc(-^°) = we get 

= {a I 0ca C tc} and Ap = {a | C p^} . 

Choose a positive system A+ in A such that A+ := {a G Ap | — i} C A+. 

Then A+ = A+ U A+ and A+ is a positive system in Ac- For P C A let fl^(P) := 
eaerflca- Then 

p+ :={XG0^| [ZO,X]=^X}=0^(A+); 
p- := {X G 0^ I X] = -zX} = fl£(-A;) . 

Furthermore p"*" and p^ are abelian subalgebras with pc = p"'" ®p~. Let := 
exp(p='=) and = exp(6^). Both P+ and P~ are simply connected closed abelian 
subgroups of G^. Hence exp: p='= — > is a diffeomorphism. Let 

(7.1) C = (exp|p+)-^:P+^p+. 

The set P+K^P- is open and dense in G^, G" C P+K^P', G^K^P' is open in 
G%. and G'' fl K^P^ = K'^. Thus G^ jK'^ is holomorphically equivalent to an open 
submanifold D of the complex flag manifold Xc = G^/ K^P~ . Furthermore the 
map pK^P~ I— » ({p) induces a biholomorphic map — also denoted by C — of C/K^ 
onto a bounded symmetric domain fie C p~ ~ ([^dimiC/K") _ 
For X G P~^ K^P~ we can write in a unique way 

(7.2) a; =p(x)fcc(a:;)(7(x) 

with p{x) G P"*", A;c(a;) G and (/(a;) G P~. For g G Gj. and Z G p"*" we introduce 
the following notations when ever they make sense: 

5-Z = C(p(5exp(Z)) GP+ 
j{g,Z) = kc{gexpZ)GK^. 
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If Z e fic and g € G'^ then g-Z is defined and g-Z £ fie- Furthermore (gi, Z) i—^ g-Z 
defines an action of C' on flc such tliat G'' / K^- VLc is a G^^-map. The map j 
is the universal automorphic factor and it satisfies the following: 

j{p, Z) = l, 

(7.3) j(a6,Z)=j(«,fe-^)j(^^), 



if A; G Z e p+, j3 G P+, and a, 6 G 
defined. 
Define 

S(Oc) := {7 e G£ 

and 



are such that the expressions above are 
7-1 • Oc C flc} 



5(fic)° := {7 e I • fic C Oc} 

where {fie} stands for the topological closure of Oc in P"*"- Then S{^c) is a closed 
semigroup in of the form 

5(0c) = G'^exp(iG„,a.) 

where Gmax is the maximal G^-invariant cone in g^. containing —Z'^. Furthermore 
S{^c)° is the topological interior of S{Vlc) and 

5(0c)° = = G^exp(iG°,J . 

We refer to [33] or [31] for all of this. 

8. Highest Weight Modules 

Our notion of reflection for unitary representations leads to the class of represen- 
tations in ^(M^) of Definition 5.2, and in the present section we analyze these rep- 
resentations more closely. The analysis is based in large part on [33] , and involves 
results of (among others) M. Davidson and R. Fabec [6], K.-H. Neeb [63, 64, 65], 
Harish-Chandra [24, 25], Ol'shanskii [80], R.J. Stanton [98], Wallach [103], and 
H. Rossi and M. Vcrgnc [102]. 

We have seen that the interesting representations are those in yl(VF) where W 
is an invariant cone in q'^. It turns out that the irreducible representations in >l(M^) 
are highest weight representations. A (g^, /r^)-module is a complex vector space V 
such that 

1) V is a g'^-module. 

2) V carries a representation of K'^, and the span of K'^ ■ v is finite-dimensional 
for every u G V. 

3) For V eV and X e t'' we have 

^_^^j.^exp(iX)^^_ 
t^o t 

4) For Y G and k G K" the following holds for every G V: 



k-{X-v) = {Ad{k)X) -[k-v] 
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Note that (3) makes sense, as K" ■ v is contained in a finite dimensional vec- 
tor space and this space contains a unique Hausdorff topology as a topological 
vector space. The (g'^, iir'^)-module is called admissible if the multiplicity of every 
irreducible representation of K'^ in V is finite. If (tt, V) is an irreducible unitary 
representation of G"^, then the space of K'^-fi.mte elements in V, denoted by V^fc, 
is an admissible (g'^, iC'^)-module. 

Let t be a Cartan subalgebra of and q'^ as in the last section. 

Definition 8.1. Let V be a (g'', ii''')-module. Then V is a highest-weight 
module if there exists a nonzero element w € V and a A € t|. such that 

1) X ■v = \{X)v for all X e t. 

2) There exists a positive system A+ in A such that 0£(A+) ■ v — 0. 

3) V = ?7(0^) • V. 

The element v is called a primitive element of weight A. 

Let W e ConcGc(fl'') and tt G A{W) irreducible. We assume that -Z° e W°. 
Then Vi^c is an irreducible admissible (g"^, /f^)-module, and 

Vifc = 0Vkc(A) 

where Vi<-<:(A) = Vx<=(A, tc). Let v G Vis:<:(A) be nonzero. Let a G A+ and let 
^ e p+ \ {0}. Then 

X'' -veYK-^iX + ka). 

In particular, 

-iZO • {X'' ■ v) = [-iX{Z°) + k]v. 
This yields the following lemma. 

Lemma 8.2. Let the notation be as above. Then the following holds: 

(i) -iA(ZO) < 0. 

(ii) There exists a A such that p+ • Vifc(A) = {0}. 

Lemma 8.3. Let be the K'^-module generated by Vx<:(A). Then is 
irreducible, Vk" = U{p~)'W'^ and the multiplicity ofW^ in Vk= is one. 

Let a G A+ then there exists a unique element Ha € itD [sconQCa] such that 
a{Ha) = 2. Let fi be the highest weight of W'^ with respect to A+ and let be a 
nonzero highest weight vector. Then is a primitive element with respect to the 
positive system A+ U A+. 

Theorem 8.4. Let p G ^(H^) he irreducible. Then the corresponding {q'',K'^)- 
module is a highest-weight module and equals t/(p~)W'^. In particular, every weight 
of Vk<= is of the form 

V — ^ UaOl . 
aeA(p+,tc) 

Furthermore, {u, Ha) < for all a G A+. 

The ^^-representation Tr"** on W'*' is called the minimal if^-type of V and V/^c. 
The multiplicity of tt'^ in V is one. We recall how to realize highest-weight modules 
in a space of holomorphic functions on C/K'^. We follow here the geometric 
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construction by M. Davidson and R. Fabec [6]. For a more general approach, see 
[64, 65]. To explain the method we start with the example ~ SU(\,V) = 



a (3 
/3 a 



l|. WesetX= 



1 




Y 





1 



and H := 



Hi 



use 



1 

-: 



. Then Z° = and p+ = CX, 6^ = CH and p" = CY. We 
this to identify those spaces with C. Let 7 = ^ ^ ^ ) ^ "^^(^j • Then 



a b 
c d 



1 z 
1 



Hence P+K^P' 

Thus 
(8.4) 
(8.5) 
(8.6) 



a b 
c d 



7 

7-1 

7 + 7~-^2; 7~^z 
d^0> and if x ■ 



1 
y 1 



a b 
c d 



e P+K^P-, then 



p{x)=b/d, kc{x) = d ^ and q{x)=c/d. 



a^K^P") = b/d 

az + b 

x ■ z = 

CZ + d 

j{x,z) = {cz + dy^ . 



To identify flc wc notice that on SU{1. 1) wc have ((x) = 0/a. Hence jK'^ ~ 
£' = {zGC||z|<1}. The finite-dimensional holomorphic representations of 
are the characters 

Xn(exp2iiJ) = e'"^. 

In particular, dxniZ''^) — in/2 or 

-idXn{Z°) = ^. 

Let (tt, V) be a unitary highest-weight representation of SU{1, 1) and assume that 
(7r,V) e A{W). Then n < by Lemma 8.2 and Theorem 8.4. Let V(n) be the 
one-dimensional space of Xn-isotropic vectors. Then 



= 0V(n-2A:), 



feel 



and the spaces V(m) and V(fc) are orthogonal if m 7^ fc. 

Let cr be the conjugation of sl(2,C) with respect to SU{1, 1). Then a is given 

by 



a b 
c d 



—a c 
b —d 



so that a{X) = Y. Since 7r(T)* = -TT{a{T)) for all T e s[(2, C) we get 

7r(F)*=7r(-X). 
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Finally, it follows from [Y,X] = -H that for v e V{n): 

\\T^{Yfvf = (Tr{Y)''v\Tr{Y)''v) 
= {Tr{{-X)''Y'')v\v) 
Lemma 8.5. Let the notation be as above. Then 

= {-n)kV 

where {a)k = a{a + 1) • • • (o + A: — 1). 
As 

°" |^2|fe 
fe=0 

(see [19]) converges if and only if |2;| < 1, it follows that 

converges if and only if zX € flc- 

Let now be arbitrary. Let a: g^he the conjugation with respect to g^. 

We use the notation from earlier in this section. Using the usual s[(2, C) reduction, 
we get the following theorem. 

Theorem 8.6 (Davidson-Fabec). Let T e p+. Define qx: Y by the 

formula 



a{TYv 



n=0 

1) If V ^ 0, then the series that defines qr converges in the Hilbert space V if 

and only if T G f^c • 

2) Let TTx be the representation of K'^ on W'^. Let 

(8.7) Mg,Z):=wx{j{g,Z)). 
Then 

(8.8) TT{g)v = qg.oMg,or-^v 

for g e G" and v G W^. 

It follows that the span of the gzW"^ with Z e fic is dense in V, since V is 
assumed to be irreducible. Define Q: flc x ^ GL(W^) by 

Q{W,Z)=q^qz. 

Then the following theorem holds. 

Theorem 8.7 (Davidson-Fabec). Let the notation be as above. Then the fol- 
lowing hold: 

(i) Q{w,z) = UcM-'^{w)),zr-\ 

(ii) Q{W, Z) is holomorphic in the first variable and antiholomorphic in the 
second variable. 
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(iii) {v I Q{W, Z)u) = {qwv \ qzu) for all u,v G Wa- 

(iv) Q is a positive- definite reproducing kernel. 

(v) Q{g ■W,g-Z) = Mg, W)Q{W, Z)Mg, Z)*. 

For Z £ and u G W^, let Fz^u ■ ^ W'^ be the holomorphic function 

(8.9) Fz,u{W):=Q{W,Z)u 
and define 

(8.10) (Ft,„ I Fz,u)q ■■= {w I Q{W, Z)u) . 

Let H(f2c, W^) be the completion of the span of {Fz^u \ Z e ^c,u G W^} 
with respect to this inner product. Then H(f2c, W^) is a Hilbert space consisting 
of W'^ -valued holomorphic functions. Define a representation of C in H(nc5 W^) 

by 

(8.11) {p{9)F){W) := J^{g-\W)-^F{g-^ ■ W) . 

Then p is a unitary representation of G"^ in H(i7c) W'^) called the geometric 
realization of (tt, V). 

Theorem 8.8 (Davidson- Fabec) . The map qzv i-^ Fz^v extends to a unitary 
intertwining operator U between (tt, V) and (p, H(ncj W'^)). It can be defined 
globally by 

[Uw] (Z) = q*zw, u> e V, Z G f2c • 

As the theorem stands, it gives a geometric realization for every unitary highest- 
weight module. What it docs not do is give a natural analytic construction of the 
inner product on H(rJc, W"^). This is known only for some special representations, 
e.g., the holomorphic discrete series of the group [23, 7, 35] or symmetric spaces 
of Hermitian type [75, 76]. At this point we will only discuss the holomorphic 
discrete series, which was constructed by Harish-Chandra in [23], in particular 
Theorem 4 and Lemma 29. For that, let p = ^ J2aeA+ ^ ^^'^ denote the 

highest weight of the representation of K"^ on W^. For f,gG H(f2c, W^), let /x be 
the ff^-invariant measure on Oc and 

{g I /)a := / (giz) I Q{z, z)-'f{z))^, d^i . 

Theorem 8.9 (Harish-Chandra [24, 25]). Assume that 
{lJ. + p,Ha)<0 foralla€A+. 

Then {g \ f)^ is finite for f,gG H(f2c) W^) and there exists a positive constant c\ 
such that 

{g I /)q = ca (5 1 /)a • 

Moreover, (p, H(Oc, Wa)) is unitarily equivalent to a discrete summand in L^(G'^). 

The Theorem of Harish-Chandra relates some of the unitary highest weight 
modules to the discrete part of the Plancherel measure. It was shown by Ol'shanskii 
[80] and Stanton [98] that this "holomorphic" part of the discrete spectrum can be 
realized as a Hardy space of holomorphic functions on a local tube domain. Those 
results were generalized to symmetric spaces of Hermitian type (or compactly causal 
symmetric spaces) in a series of papers [75, 76, 34, 79, 2] 
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The last theorem shows in particular that the corresponding highest weight 
modules arc unitary. It was shown by Wallach [103] and Rossi and Vcrgnc [102] 
that those are not all the unitary highest weight modules. The problem is to decide 
for which representations of K'^ the reproducing kernel Q{Z, W) is positive definite. 
Wc refer to [10, 38] for the classification of unitary highest weight modules. We 
will from now on assume that the representation of K*^ is a character x\ where 
A e ii* is trivial on t n[6, 1]. Choose a maximal set {71, . . . ,7^-} of long strongly 
orthogonal roots in A+. This can be done by putting r = rank(G'^/i4'^) and then 
choosing 7^ to be a maximal root in A+, 7^-1 maximal in {7 € A+ | 7 strongly 
orthogonal to 7^}, etc. Let Hj := H^^ and 

(8.12) a = i0Mi?jCt. 

j 

By the theorem of Moore (see [27]) we know that the roots in Ap restricted to a, 

are given by ±^(7^ + 7^), 1 < i < j < r and possibly ^7^. The root spaces for 7^ 
are all one- dimensional and the root spaces 1 (^._|_^^), I < i < j < r, have all the 
common dimension d. 

Theorem 8.10 (Vergne-Rossi [102], Wallach [105]). Assume that C is sim- 
ple. Let Ao e a* he such that (Aq, i?r) = 1- Let 7 = (Aq, Z'^) and let 

_ nir-i)d 

For V ~ p < Lpos there exists a irreducible unitary highest weight representation 
{pi,, K^) of C with one- dimensional minimal K''-type v — p. 

Proof. By [102, pp. 41 42] (see also [104]), (pi.,Ka) exists if {v- p,Hr) < 
Butz/-p= {iy-p,Hr)Xo. Hence {u - p,2Z°) = {u - p,Hr) {\o,2Z°) = 
lW-p,Hr). □ 

We will later specialize this to the case where C/K'^ is a tube type domain, 
that is biholomorphically equivalent to K" + ifi, where n = dime /K'^, and 17 
is a self-dual regular cone in R". If we assume simple, then this is exactly the 
case if is locally isomorphic to one of the groups: SU{n,n), SO* {in), Sp{n,M.), 
SOo{n,2) and Ey(^_25). In this case we have 



and 



(8.14) a; = !^j,,^{jk + jj) l<i,j,k<r, J <k^ 

(8.15) A+ = |i(7fc - 7,) 1 < i < fc < r| . 

In this case we have: 

Lemma 8.11. Assume that G^/K is a tube-type domain, then 7 = r and u—p < 
Lpos if and only if u <r. 
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Proof. If C/K" is of Cayley type then 2^° = iE^^i -^i and 7^ = 7^ - 
X^ncQ!, a e A+, Ha > 0. Thus (z/ - p, Z^) =r{u - p, Hr). We also have (see [79]) 

1 / (r - l)d\ , 
P=2(l + S^j (7i + ---+>). 

Prom this the theorem follows. □ 

Remark 8.12. Let us remind the reader that we have only described here the 
continuous part of the unitary spectrum. There are also finitely many discrete 
points, the so-called Wallach set, giving rise to unitary highest weight representa- 
tions. 

Remark 8.13. Let cr: g^. — > 0^. be the conjugation with respect to g^. Thus 

a{X + iY)=X- iY, X,Y e g". Then cr(p+) = p" and cr(t^) = tj;. In this section 
we viewed Q{W, Z) as a function on flc x ^^C) holomorphic in the first variable and 
antiholomorphic in the second variable. In many applications it is better to view 
Q as a function on Oc x c(f^c), holomorphic in both variables. 



9. An Example: SU{1, 1) 

The simplest case of a non-trivial reflection positivity is the case G 
and = SU{1, 1). In this case 



SL(2,I 



GyK" = D:={zgC\\z\<1} 



and SU{1, 1) acts by 



a b 
b a 

Let (7 : D ^ D he complex conjugation, z 
the involution given by 

a b 
c d 



bz + a 

z and let r: SL{2,C) 



SL{2,C) be 



1 

1 



a b 
c d 



(9.16) 

Then a{g ■ 0) = T(g) • for 5 € SU{1, 1, ). We have 
He 

and 





w \ 










^ J 





(9.17) 



H = ±ih 



cosh(f) sinh(t) 
sinh(t) cosh(t) 



t e 



SUil,l)nSL{2,] 



Knowing that the representations of 



H/{±I} = (-1,1) and G 5L(2,I 

SU{1, 1) that we can get are highest weight modules, we see by looking at the 
infinitesimal character of those representations, that we have to start with the 
complementary scries representations of G = SL{2,M.). They are constructed in 
the following way. Let P be the parabolic subgroup 



a e 



G n K^P+ . 
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For s e C, let tts be the representation of G acting by [TTs{a)f]{b) = f{a ^6) on the 
space Hg of functions / : G — > C, 



f{gpia,x)) = \a\-(^+'^f{g), [ \f{k)\Uk<cx^, 

JSO{2) 

and with inner product 

{f\9)= [ mg{k)dk, 

JS0(2) 

that is TTg is the principal series representation of G with parameter s. A simple 
calculation shows that the pairing 



(9.18) 



H«xH_, 9(/,5)^^ 



.f{k)g{k) dkeC 



SO{2) 



is invariant under the group action. The representations tTs are unitary in the above 
Hilbert-space structure as long as s € iR. Let 



fitPil, x) ■- 



t e 



+ xt 

a b 
c d 



Then 

/ ^ 

r>.j.7i{^ T.^ = \ 

, 7* 7 

Hence as we have seen before NP - 

7 = a, t = c/a . 



a b 
c d 



a ^ > and 



(9.19) 

In particular we have 

cosh(t) sinh(t) 
sinh(f) cosh(t) 



1 
tanh(f) 1 



cosh(t) 
1/ cosh(t) 



1 tanh(t) 
1 



Thus HP/P ~ (—1, 1), but we notice that this is not the realization in p+ but in 
p~. By (9.19) this is expressed in the action of G by 



(9.20) 



a b 
c d 



dz - 



opp ^ — , I 

bz + a 

Notice that this is the usual action twisted by r, that is 



(9.21) 



9- 



opp 



i5) 



where • stands for the usual action. By identify A'' with M using t, we can 

realize the principal series representations as acting on functions on M (compare to 
(9.20)): 



a b 
c d 



f{t) = \d-btr-'f 



— c + at 
d-bt 



(9.22) 71 

1 /-oo 

(9.23) {f\9) = - m 9{m + dt 
and the pairing in (9.18) is simply 

(9.24) {f\9) = - r W)9{t)dt. 

J-oo 
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For defining the complementary series we need the intertwining operator Ag : Hg 
H_s defined by 



1 r°° 

(9.25) A,{f){g) = - / figwfiy) 

for Re s > and then generally by analytic continuation. Here w is the Weyl group 
' l\ , _ A 0^ 



dy 



element ^ = qJ ^^'^ ~ l^y ij' '^^^ realization of the representation 

on R we get 

(9.26) AJ{x) = - f{y)\x-yr'dy. 

J-oo 

By (9.24) the bihnear form 

-| poo poo 

(9.27) {f\A,g) = - / J(^g{y)\x-yrUxdy 

^ J —oo J — oo 

is G-invariant and actually the representation tt^ is unitary for < s < 1. Define 

jf{t) = \tr-'f{i/t) 

or on the group level Jf{a) := f{T{a)w~^) = f{T{aw)). The map J: Hg — > 
intertwines tTs and tt^ o r ~ tt^, = 1, and 



1 f'°° 

A,{J{g)){x) = - g{y)\l-xyr^dy. 

J — oo 



Hence 

(9.28) (/|5)^ = (/|yl,J5) = _ / / J(x)g{y)\l-xyrUydx. 

^ J —oo J — oo 

We recall now the reproducing kernel Q(w, -z) from Section 8, corresponding to the 
lowest ii'^^-type s — 1. In our case 

(9.29) Qiw,z) = {l-wzy-K 

which by Theorem 8.11 is positive if and only if s < 1. It follows that ( • | ■)j is 

positive definite on the space of fimctions supported on the H-orbit (—1, 1). Let 
Ko be the closure of C^(— 1, 1). Notice that the above inner product is defined on 
C^(— 1, 1) for every s as we only integrate over compact subsets of (—1, 1). As we 
are using the realization in p~ we define the semigroup now by 

(9.30) S = S-in) := {7 e 5^(2,111) | 7 • (-1, 1) c (-1,1)} . 

Then iS is a closed semigroup of the form H = exp(C) where C is the iJ-invariant 
cone generated by ^ ^ ^ ^ . Let us remark here, that if 7=^^ ^^e5, 
then d — bt > for \t\ < 1. The semigroup S acts on Ko and by the Liischer-Mack 

Theorem 6 we get an highest weight module for ^^^(l, 1), which is irreducible as 
we will see in a moment. 

We also know (see [33] ) that S = H exp C is a closed semigroup and that 
7/ C /, and actually S is exactly the semigroup of elements in SL{2,R) that act 
by contractions on /. Hence 5 acts on K. By a theorem of Liischer and Mack 
[31, 60], the representation of S' on K extends to a representation of G"^, which in 
this case is the universal covering of SU (1,1) that is locally isomorphic to SL{2, R). 
According to Theorem 6.5 the resulting representation is a direct integral of highest 
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weight representations. We notice that this defines a representation of 5'L(2,R) if 
and only if certain integrality conditions hold; sec [44]. The question then arises 
to identify this direct integral and construct an explicit intertwining operator into 
the corresponding space of holomorphic functions on D. 

We notice first that the kernel (y, x) i-^ Q{y, x) = {1 — yxy~^ is the reproducing 
kernel of the irreducible highest weight representation given by 

(9.31) [Ps{g)f]{z) = i-cz + ay-'f (^^) , 9-^1 J ) • 

In particular Q{y,x) extends to a holomorphic function on D x a{D) according to 
Remark 8.13. For / e C~(-l, 1) define 

(9.32) Uf{z):=- [ f{u){l- zuy-^du=- f f{u)Q{z,u) du . 
By simple calculation, using (9.21), we get for 7 = ^ ^ ^ ) ^ S-{0): 

U{n,{'y)f){z) = i j\d-bt)-'-'f ( ^^r^) (1 - zty-' dt 



at — c 

/(w)(cM + d)"'^ (1-2^-^ ) du 



1 



hu + a 



^ ^ du 



1 

— / f{u) {hu + a — dzu — cz) 
1 

— / f{u) {—cz + a — {dz — b)u) 

J -I 



^ ^ du 



—cz + a 



= Ps{^)Uf{z). 



where the respective representations are given by (9.22) and (9.31). Here the last 
equality follows from (8.6), (8.7) and (8.11). As ps is irreducible it follows that 
either U is surjective or identically zero. Using that Q{z,u) is the reproducing 
kernel for the representation we get for / and g with compact support: 



fiu)g{v) {Qi-,u)\Q(-,v)) dvdu 

1 

f{u)g{v)Q{u, v) dv du 

-1 



It follows that [/ is a unitary isomorphism. 

We can describe J7 in a different way using the representation ps instead of the 
reproducing kernel. Let 1 be the constant function z 1. Then 

(9.33) [Ps{9)t]{z) = Js{g-\z) = i-cz + ay-' . 
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We therefore get 
(9.34) 



f{h)ps{h)t{z) dh=- I [cosh(t)""-V(tanh(f))] (- smh{t)z + cosh(i))'-^ dt 



H 



1 

= - / f{u){l-uzy-'^du 

J-1 

= Uf{z) . 



We will meet the transform in (9.34) again in the generalization of the Bargmann 
transform in Section 11. That shows that the Bargmann transform introduced 
in [78] is closely related to the reflection positivity and the Osterwalder-Schrader 
duality. 

In summary, we have the representation tts from (9.22) acting on the Hilbert 
space H_|_(s) of distributions obtained from completion with respect to 



fj'j{x)f{y)il-xyr-' dx 



dy, 



and the unitarily equivalent representation ps from (9.31). The operator U from 
(9.32) intertwines the two. Moreover U passes to the distributions on (—1, 1), in 

the completion H+(s), and we have 

(9.35) U (<5(")) = 

where, for n = 0, 1, 2, ... , S^"^ = (d/dx)" S are the derivatives of the Dirac "func- 
tion" , defined by 

(9.36) (/,<5(")) = ((-l)"/("\'5) = (-1)"/^"^ (0), 

where / is a test function. Furthermore, z" are the monomials in the reproducing 
kernel Hilbert space H(s) corresponding to the complex kernel (1 — zwY~^. This 
Hilbert space consists of analytic functions f (z) = X^^o^"-^"' defined in D = 
{z G C \ \z\ < 1}, and satisfying 



n=0 



where the ^ ) refers to the (fractional) binomial coefficients. This sum also defines 



the norm in H(s). For every w & D, the function {z) := (1 — wzY ^ is in H(s), 
and for the inner product, we have 

{Uwi I l*«)2>H(s) = (1 ^ WiW2y~'^ ■ 

So H(s) is indeed a reproducing kernel Hilbert space, as it follows that the values 
/ {z), for / e H(s) and w G D, are given by the inner products 

f{w) = I /)h(s) • 

Since Uw{z) = X^^q (^n^)^"-^"' ^® conclude that the monomials form an 
orthogonal basis in H(s), and it follows from (9.35) that the distributions 5^"\ 
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n = 0, 1, 2, . . . , form an orthogonal basis in the Hilbert space H+(s), and that 
gin) 2 ^ n\{l-s) (2-g)---(n-5) ^ 

H+(s) TT^ 

10. Reflection Symmetry for Semisimple Symmetric Spaces 

The main results in this section are Theorems 10.18 and 10.20. They are stated 
for non-compactly causal symmetric spaces, and the proofs are based on our Basic 
Lemma and the Liischcr-Mack theorem. At the end of the section wc show that 
results from Jorgensen's paper [41] lead to an extension of the scope of the two 
theorems. 

We now generalize the construction from the last section to a bigger class of 
semisimple symmetric pairs. We restrict ourself to the case of characters induced 
from a maximal parabolic subgroup, which leads to highest weight modules with 
onc-dimcnsional lowest K'^-typc. This is meant as a simplification and not as a 
limitation of our method. An additional source of inspiration for the present chapter 
is the following series of papers: [66, 72, 77, 75, 76, 78, 46, 50, 84, 91, 95]. 

Assume that G'^/K'^ = _D ~ ftc C is a boimdcd symmetric domain with 
simply connected and simple. Let O'^ be the Cartan involution on corresponding 
to K^. Let (t: be a conjugation, that is a non-trivial order two antiholo- 

morphic map. Those involutions were classified in [36, 37], see also [33, 71, 72]. 
Then a defines an involution on the group Io{D), the connected component of 
holomorphic isometrics oi D, by 

T{f){Z)^a{f{a{Z))) . 

But Io{D) is locally isomorphic to G^, see [27], Chapter VIIL Hence r defines 
an involution on G" and q". Let H'^ = G"^ , and = {X G \ t{X) = X} and 
= {X e 0^= ] t{X) = -X}. Then = f} ® We define 

£1 := () ® iq'^ 

and q ={X € g ] t{X) = —X} = iq'^. Then (g,T) is a symmetric pair. Let Gc be 
a simply connected Lie group with Lie algebra gc and let G C Gc be the connect 
Lie group with Lie algebra g . Then r integrates to an involution on G. Let 
H = G'^ = {a E G \ T(a) = a}. Then G/H is a symmetric space. The involution 
9'^ integrates to an involution on G and 9 :— t9'^ is a Cartan involution on G that 
commutes with r. Let K be the corresponding maximal almost compact subgroup. 
Denote the corresponding Cartan decomposition as usually by g = ? © p. 

As T is antiholomorphic it follows that t{Z^) = — where is a central 
element in 6° with eigenvalues 0, z, — i. Hence G" /H" is a symmetric space of Her- 
mifian type, in the sense of [75]. Those spaces are now usually called com,pactly 
causal symmetric spaces because those are exactly the symmetric spaces such that 
q contains a regular il-invariant cone C with C° fl t ^ 0. The minimal cone is 
given by 

Cmin = •conv{Ad(i?)ZO}. 

The dual spaces G/H arc exactly the non-compactly causal symmetric spaces. 
Those are the symmetric spaces containing ff-invariant regular cones G such that 
G° n p ^ 0. We use [33] as a standard reference to the causal symmetric spaces. 
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Example 10.1 (Cayley type spaces). A special case of the above construction 
is when C / K''' is a tube type domain. Let c be a Cayley transform from the 
bounded realization of G'^jK'^ to the unbounded realization. This can be done 
by choosing c = Ad(exp(^y°)) where ad(F°) has eigenvalues 0,1,-1. Then 
Ad(c)* = id and r = Ad(c)^(G"^) = C . Hence r is an involution on . It is 
also well known that t{Z°) = —Z°. Hence r defines a conjugation on D. The 
symmetric spaces G/H are the symmetric spaces of Cayley type. We have e f) 
is central and 3g(l^") = (). Furthermore Ad(c) is an isomorphism ~ q. The 
spaces that we get from this construction are locally isomorphic to one of the 
following symmetric spaces, where we denote by the subscript + the group of el- 
ements having positive determinant: Sp{n,M.)/GL{n,'M.)^, SU{n,n)/GL(n,C)^, 
SO*{'in)/SU*{2n)R+, 30(2, k)/ 30(1, k - 1)R+ and Er(^_25)/Ee^_26)^+. 

Example 10.2. Assume that i? is a connected Lie group such that H/Kh, 
Kh a maximal compact subgroup of H, is a bounded symmetric domain. Let G'^ = 
HxH and D = H / Hk x H/ Hk, where the bar denotes opposite complex structure. 
Let r((i, c) = (c. d). Then r is a conjugation with fixed-point set the diagonal. The 
corresponding involution on G"^ is T{a,b) = ib,a). Thus G*^^ = diagonal ~ H. 
Identify G"^"^ with H. Then G/H 9 (a, b)H i-^ ab~^ S if is an isomorphism. In this 
case G is locally isomorphic to He and the involution t on g is the conjugation with 
respect to the real form f) C fl. Let Hi be the corresponding analytic subgroup. 
Then H\ is locally isomorphic to H and the symmetric space we are looking at is 
Gc/Hi. 

We will need the following facts. Let X° = -iZ° e q n p. Then X° is H n K- 

invariant, 

(10.37) 3B(^°) = «cn0 = en[)®pnq, 

Let n := p+ n g, ia := p" n g, and p^ax := (?c ® P^) ^ 0- Then pmax is a 
maximal parabolic subgroup of g of the form pmax = tn ® RX*^ ® n, where m = 
{Xetn[)©pnq| B{X, X^) = O}, S the KiUing form on g. We have HDK = 
Z{X^). Let A := exp(a), N := exp(n), N := exp(tt). Mq the analytic subgroup of 
G corresponding to m, and M :— {H n K)Mo. Then M is a closed and r-stable 
subgroup of G, M n A = {1}, MA = Zg{A), and P^^ = Ndpraa^) = MAN. We 
have 

g = f) © pmax • 

Let n = T(f2c) n g C n. Then by [11]: 

Lemma 10.3. .ffPmm is open in G and -ffPmax = exp(Q)Pmax C NPmaK- 

Let a = RX^ and A := exp(a). We need to fix the normalization of measures 
before we discuss the generalized principal series representations. Let the measure 
da on A be given by 

/ /(a) da = / /(at) dt, at = exp 2tX° . 

J A V 27r J-oo 

Then Fourier inversion holds without any additional constants. We fix the Lebesgue 
measure dX on il such that, for dfi = exp(dX), we then have 



/. 



a{n)-^Pdn=l. 
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Here p{X) = itr(ad(X))| n as usual, and a{g) Q A, g Q G, is determined by 
g G KMa{g)N . The Haar measure on compact groups will usually bo normalized 
to have total measure one. The measure on N is 9{dn). We fix a Haar measure dm 
on M, and dg on G such that 

/ f{9)dg= f f f f f(kman)a^P dndadmdk, feC^{G). 
Jg Jk jm J a jn 

Then we can normalize the Haar measure dh on H such that for / e C^{G), 
supp(/) C HPrna.^, wc have, sec [70]: 

/ f{g)dg= / / / / f{hman)a^''dndadmdh. 
Jg Jh Jm J a Jn 

The invariant measure dx on G/H is then given by 

/ fix) dx= f f f{xh) dh dx, f e Ce(G) 
Jg Jg/hJh 

and similarly for K/ Hf\K. 

Lemma 10.4. Let the measures he normalized as above. Then the following 
hold: 

1) Let f €Cc{NMAN). Then 

/ f{9)dg= / / / / f {nmarija^'' dn dm da dn . 
Jg Jn Jm J a Jn 

2) Let f e Cc(iV). For y G NMAN write y = n{y)mff{y)afi{y)nj^{y). Let 
X gG. Then 

I finixn))a,ixn)-^^dn = [ fin)dn. 

Jn Jn 

3) Write, for g £ G, g = k{g)m{g)a{g)n{g) according to G = KM AN. Let 
heC{K/HnK). Then 

[ h{k)dk= [ h{k{n)H r\ K)a{n)-'^P dn . 

JK/HnK Jn 

4) Let h e C{K/H n K) and let x e G. Then 

[ f{k{xk)HnK)a{xk)-^Pdk= [ f{k)dk 

5) Assume that supp(/) C H/H r\K c K/H n K. Then 

[ f{k)dk= [ f{k{h)Hr\K)a{h)-'^Pdh. 
Jk/HCiK Jh/h^k 

6) LetfGCciN). Then 

[ f{n)dn= [ f{n{h))aj^{h)-^Pdn. 
Jn Jh/hcik 

7) For X G ffPmax urrite x = h{x)mH{x)aH{x)nH{x) with h{x) e H, mH{x) G 
M, anix) e A, and nnix) € N. Let f e C^{H/H n K) and let x e G be 
such that xHPmux C HPy^ 



L 



f{h{xh)H(lK)aH{xh)-^Pdh= [ f{h)dh 
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Identify with C by 9 i-^ 2i/(X°) e C. Then p corresponds to dimn. 
For V e a,J, let C°°(i') be the space of C°°-functions /: G — > C such that, for 
at = expt{2X^), we have 

f{gma,n) = 6-^'^+"^' f{g) = a^^'+'^fig) . 
Define an inner product on C°^'{i>) by 

{f\g),:= I W)mdk= j mg{k)dk. 

Jk JK/HnK 

Then C°°{v) becomes a pre-Hilbert space. We denote by H(z/) the completion of 
C°°(!/). Define tt{i^) by 

[TT{'^){x)f]{g) := .f{x-^g), x.geG, feC°-{v). 

Then 'k{v){x) is bounded, so it extends to a bounded operator on H(i/), which we 
denote by the same symbol. Furthermore -k{u) is a continuous representation of 
G which is unitary if and only if G iR. By [90] wc have H(i^)°° = C°°{v). Wc 
can realize H(i/) as 'L'^{K/H n K) and as L^(iV,a(n)^^'^''^) dn) by restriction (see 
Lemma 10.7). In the first realization the representation Tr{u) becomes 

[7T{u){x)f]{k) = aix-'ky-'-Pfikix-'k)) 

and in the second 

[Kiu){x)f]{n) = ajfix-'n)-''-''f{n{x-'n)) . 
Lemma 10.5. The pairing 

H(z/) X Hi-P) B if, g)^{f\ g), := / Wigik) dk = [ mg{k) dk 

Jk JK/HnK 

is G -invariant, i.e. 

(^M(a^)/l5). = (/kM)(a;-^).9), . 

Remark 10.6. We notice that if u is purely imaginary, that is —i> = v, the 
above shows that (7r(z/), H(z/)) is then unitary. 

Lemma 10.7. Let the notation be as above. 

1) On N the invariant pairing {■ \ • )^ is given by 

if \9).= [ W)9{n) dn, / e H(i.), g e H(-i7) . 

2) Let HH(zy) be the closure of {/ € C~(z/) | supp(/) C -ffPmax}. Then 
Hff(i^) 3 f ^ }\h e L^{H/Hr\K,a{hf^<''Uh) is an isometry. 

3) Let f € H(i/), g £ H(— i/) and assume that supp{fg) C HP^^ax- Then 

{f\9).= [ W)9{h)dh. 

JH/Hr\K 

Let us assume, from now on, that there exists an element w G K such that 
Ad{w){X^) — —X^. In particular such an element exists if —1 is in the Wcyl group 
W{aq) := NK{aq)/ZK{aq), where C pfiq is maximal abelian (and then maximal 
abelian in p and q). This is always the case if G/H is a, Cayley type space because 
G is then a Hermitian groups which implies that 6 is an inner automorphism. The 
element w does also exists if G is a complexification of one of the groups 5p(n,M), 
5u(n,n), 50*(4n), so(2, fc) and e7(_25), see [46], Lemma 5.20. 
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Let US work out more explicitly the details for the representations of the Cayley- 
typc spaces in order to compare the existence of (/O^jK,^) to the existence of the 
complementary series, see Lemma 10.8 below: 

For "big" V define the intertwining operator A(y) : H(j/) H(— z^) by the 
converging integral 

[M^) f]{x) I f{gnw)dn, 

see [51, 105]. The map i-^ A.{v) has an analytic continuation to a meromorphic 
function on intertwining Tr{v) and 7r(— z^). Using Lemma 10.5 we define a new 
invariant bilinear form on (v) by 

{f\9). ■■= (/I^W.- 

If there exists a (maximal) constant R > such that the invariant bilinear form 
(• I is positive definite for < R, then we complete C^(i') with respect to 
this new inner product, but denote the resulting space by the same symbol H(i/) 
as before. We call the resulting unitary representations the complementary series. 
Otherwise we set R = 0. We compare here the constant R for the Cayley type 
symmetric space, see [81, 93, 94], and the constant Lpos + p from Theorem 8.11. 
We notice that in all cases R < ipos + P- 

Lemma 10.8. For the Cayley-type symmetric spaces the constants R and ipos + 
p are given by the following table: 






R 


Lpos + P 


su(2n+ l,2n+ 1) 


2n + l 


2n+ 1 


5u(2n, 2n) 





2n 


so* (An) 


n 


2n 


0p(2n,R) 


n 


2n 


5p(2n+ 1,M) 





2n + l 


so(4n + 2,2) 


2 


2 


so(2n+ 1,2) 


1 


2 


so(4n,2) 





2 


E7(-25) 


3 


3 



Lemma 10.9. w ^t{N)w = N, and ip: N 3 w ^T(n)w € N is unimodu- 

lar. 

Proof. The first claim follows as Ad(«;) and r act by —1 on a, and thus map 
N onto N, and N onto A''. The second follows as we can realize ip^ by conjugation 
by an element in M O K. □ 

Lemma 10.10. For f e H(z/) let J{f){x) := f{T{xw)). Then the following 

properties hold: 

1) J{f){x)=f{T{x)w-^). 

2) J{f ) e H(i^) and A{y)J = JA{u). 

3) J: H(j/) H(i^) is a unitary isomorphism. 

4) J2 = id. 

5) For X G G we have J o n{i'){x) = n{v'){T{x)) o J. 
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Notice that 

(10.38) [A{v)J]{f){x) := I f{T{x)n)dn 

for Re A "big". By simple calculation we get: 

Lemma 10.11. Assume that G/H is non-compactly causal. Then A{i')J inter- 
twines 7r(i/), and 7r(— z/) o r if A{u)J has no pole at v. 

Equation (10.38) and Lemma 10.11 show that even if each one of the operators 
A(y) and J does not exist, the operator A{v)J : H(i^) H(— z^), [A(i^)J] o 7r(i^) = 
[7r(— !/)or][A(i/)J], will always exist. The next theorem shows that the intertwining 
operator A{y)J is a convolution operator which kernel y,x aj^{T{y)~^x)''~''. The 
importance of that is that NMAN = {P-K^P+) n G and hence 

(10.39) aj^ixy-P = kciT{x))-''+P 

where kc denotes the i<r^— projection from (7.2). Here we have used that t{X'^) = 
— X". The reflection positivity then reduces to the problem to determine those v 
for which this kernel is positive semidefinite. 

Theorem 10.12. 

(i) LetfeC°°{u). Then 

[A{u)J]{f){n) = [ f{x)ar^{T{n)-'xr-Pdx. 
Jn 

(ii) 7/supp(/) C HP^^^, then for h & H 

[A{v)J]{f){h) = [ f{x)af^{h-^xY-Pdx. 

JH/HnK 

Proof. We may assume that v is big enough such that the integral defining 
Aiy) converges. The general statement follows then by analytic continuation. We 
have 

[A{v)J]f{n)^ I Jf{nwx)dx 

JN 

= j f{T{h)w~^T{x)'w) dx 

= jf{rin)x)dx 

= j f{n{T(n)x))aii(T{n)x)-^''+pUx. 
Now a^{T{n)x) = aff{T{n)~^n{T{n)x))~^ . By Lemma 10.4 we get 

[A{u)J]f{n) = J f{niT{n)x))af^{T{n)-'^n{T{n)x)y-Paf^{T{n)x)-'^''dx 

= J f{x)a^{T{n)-^xy-Pdx. 

The second statement follows in the same way. Let C^(f7,z/) be the subspacc 
of C°°(i/) consisting of functions / with support in exp flP^ax, and with supp(/|n) 
compact. □ 

Lemma 10.13. Let f,g e C^(n,z/). Then the following holds: 
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(i) (/ 1 9) J = Im In f{x)9{y)aMir{x)-^yr-P dx dy . 

(ii) (/ 1 fl) J = !H/HnK IH/Hnx f{h)9ik)aff{h-'kr-'' dh dk . 

Let a: flf. — > 0J. be the conjugation with respect to q'^. Then C7|g = r|g. This, 

the fact that = (7(r^c) H g, and Theorem 8.7, part (i), imphes that 

(10.40) (X, Y) ^ a^(r(exp(X))-i exp(y))"^"'' = Q(a(r), =: (F, X) , 

where Q is the reproducing kernel of the representation p^, see (10.39). Notice the 
twist by a that conies from the fact that we are using the realization of fl inside p~ 
whereas wc have realized Oc inside p+. It follows that the integral kernel is positive 
definite. Hence ( • | • )j is positive definite on the space of functions supported in 
-ff-Pmax- We let Ko be the completion of C^(f2, v)- 

What is still needed for the application of the Liischcr-Mack Theorem is the 
invariant cone C C q and the semigroup S. For that we choose Cmin as the minimal 
invariant cone in q containing X^, that is Cmin is generated by Ad{H)X^. We notice 
that 

Ad(exp(iX°))X = e-'X , VX e n. 

Hence Ad(exp tX'^) acts by contractions on if t > 0. Let 

S{n) := {.9 e G I gH C HP^,^} = {g € G \ g ■ ft C n} . 

Then S{Q) is a closed semigroup invariant under s := r(s)~^. It follows by 

construction that 5(0) C ilPmax- We remark the following results: 

Lemma 10.14. Let C = Cmax be the maximal pointed generating cone in q 

containing X'^ . Then the following hold: 

(i) Lett>0 and Y £ Q. Then exptX° G S and exptX° ■ Y = e'^Y. 

(ii) 5(0) = Fexp Cmax. 

Proof. (1) is a simple calculation. For (2) see [31] and [33]. □ 

Corollary 10.15. The semigroup 5(Cmin) = -ffexp(Cmin) acts by contrac- 
tions on fl. 

Lemma 10.16. Let s e 5(0) and f e C^(0,i/). Then 7r(i/)(s)/ e C~(0,i/), 
that is C^{Q) is S{Q) -invariant. 

Proof. Let / e C^i^) and s G 5. Then TT{u){s)f{x) = f{s-^x) ^ only 

if S~'^X e SUpp(/) C HPmaK. ThuS SUpp(7r(z/)(s)/) C SSUpp(/) C sifPmax C 
-ff-Pmax- □ 

Wc still assume that C is simple. Let {p^, Kj^) be as above. Let 1 G K^(A — p) 
be the constant function Z ^ 1. Then = 1. Let H" := {Cf . Then H'= is 
connected. Let H be the universal covering of H'^ and then also Hg- We notice 
that 

Hyn^nK" = H/HnK. 

Denote the restriction of pi, to H'^ by pu.H- We can lift p^,H to a representation 
of H also denoted by Pv,H- We let C = Cmin be the minimal i?-invariant cone in 
q generated by X^. We denote by C = Cmin the minimal C^-invariant cone in ig"^ 
with Cn q = pr q (C) = C, where pr^ : g ^ q denotes the orthogonal projection (see 
[33, 71]). As 

-^pos < it follows that px extends to a holomorphic representation 
of the universal semigroup r(G'^, C) corresponding to and C (see [31, 56]). Let 
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be the analytic subgroup of Gc corresponding to the Lie algebra q'^. Let Hi 

be the analytic subgroup of corresponding to f). Then — as we are assuming 
that G C Gc — we have Hi = Ho- Let k: G° — * G^ be the canonical projection 
and let Zh = k~^{Zg^ n H,,). Then is trivial on Zh as u — p is trivial on 
exp([r,r]) D HTi K". Thus p^ factors to G^/Zh, and to T{G'',C)/Zh. Notice 
that {G'^/Zh)1 is isomorphic to H,,. Therefore we can view Ho as subgroup of 
G'^/Zh, and So{C) = i/oCxpG as a subsemigroup of T{G'^,C)/Zh- In particular 
Ti,{s) is defined for s e So{C). This allows us to write piy{h) or Pv,H{h) for h G Hg. 
Using (10.39) and Lemma 8.2 we get 

anihf'P ^{t,p,^H{h)t) . 

In particular we get that (/i, A:) aj^{h~^kY~'' is positive semidefinite if v—p < 

Let us now consider the case G = He and G'^ = H x H . Denote the constant 
Lpos for H by Spos and denote, for ^ < Spos, the representation with lowest HClK- 
type p by (r^, L^). Let be the conjugate representation. Recall that we view H 
as a subset of G^ by the diagonal embedding 

HBhi — >{h,h)€ A(G^) := {{x, x) e G'= \ x e H} . 

The center of F is two dimensional (over R) and generated by i(X",X°) and 
i{X°,-X°). We choose = i{X°,-X'^). Then p+ = n x n.' Let 1 again be 
a lowest weight vector of norm one. Denote the corresponding vector in the conju- 
gate Hilbert space by 1. Then for h G H: 

(1 1 1 O f^(/i, h)l 1) = (1 1 Tx{h)l) (1|ta(/i)1) 

= \{t\r,{h)t)f 

Thus we define in this case Lpos '■— SS'pos- As before we notice that ® 
f^{h, (8) 1 is well defined on H. We now have a new proof that ( • | • ) is positive 
definite on CI. 

Lemma 10.17. For v — p < Lp^s there exists an unitary irreducible highest 
weight representation (p^,Ky) of G" and a lowest K'^-type vector 1 of norm one 
such that for every h G H 

af^ihy-P = {t\rx{h)l) . 

Hence the kernel 

{HxH)B {h,k) I — > afi{k-^hy-P e R 

is positive semidefinite. In particular {■ \ ■)j is positive semidefinite on C^(0, v) 
forv- p< Lpos- 

The Basic Lemma and the Liischer-Mack Theorem, together with the above, 
now imply the following Theorem: 

Theorem 10.18 (Reflection Symmetry for Complementary Series). Let G/H 
be a non- compactly causal symmetric space such that there exists a w G K such 
that Ad(u>)||j = —1. Let TT{iy) be a complementary series such that v < Lpos- Let C 
be the minimal H -invariant cone in q such that S{C) is contained in the contraction 
semigroup of HP^naK in G/P^ax.- Let SI be the bounded realization of H/H (IK in 
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n. Let J{f){x) := f{T{x)w-'^). Let Kq be the closure ofC^{n,iy) in H(i/). Then 

the following hold: 

1) (G, T, 7r(i^), C, J, Ko) satisfies the positivity conditions (PR1)-(PR2). 

2) ^{ly) defines a contractive representation 7r(z/) of S{C) on K such that 

3) There exists a unitary representation tt"^ of C such that 

i) dTr{v)%X) = dTTiiy){X) VX e t). 

ii) djfluyiiY) = i d7t{iy){Y) VF e C. 

We remark that this Theorem includes the results of R. Schrader for the com- 
plementary series of SL{2n,C) [95]. In a moment we will show that actually 
n{i'y ~ Pi,, where is the irreducible unitary highest weight representation of 
C such that 

aihy-P = {l\p4h)l) 

as before. From now on wc assume that v ~ p < Lpos- We notice that the inner 
product ( • I A{v)J{ ■ )) makes sense independent of the existence of w. Let Kq be 
the completion of C^(0, in the norm (• \A{i/)J{-)). Let N be the space of 
vectors of zero length and let K be the completion of Kq /N in the induced norm. 
First of all we have to show that 7r(i/)(7) passes to a continuous operator 7r(z/)(7) 
on K such that 7f(z/)(7)* = Tt{i'){T{'y)~^). For that we recall that 

(10.41) H/H nK = Ho/ Ho nK = n 

so we my replace the integration over H in {f \ A{y)Jf)^ with integration over Hg- 
Motivated by (9.34) we define for / e C^(0, v) 

(10.42) U{f)=p^{f)l:= [ f{h)p,{h)tdh 

(10.43) = / afi{h)-''-Pf{h-Q)J^{h,-)-^dh. 

J Ho 

Lemma 10.19. Assume that v — p < Lpos- Let p^,, K,y and U he as specified in 
Lemma 10.17 and let f,g£ ly) and s £ S{C). Then the following hold: 

1) {f\mj]{g)), = {Uf\Ug). 

2) C/(7r(i/)(s)/)=p.(s)f/(/). 

3) 7r^(s) passes to a contractive operator n{i'){s) on K such that 7r(i/)(s)* = 

7f(i.)(r(.)-i). 

Proof. (1) Let / and g be as above. Then 
{f\[A{u)J]{g))= [ [ J{h)g{k)aj^{h-'kr-Pdhdk 

JHo/HonK JHo/HoCiK 

= [ [ J(Ji)g{k){t\p^{h-^k)t) dhdk 

JHo/HonK JHo/HonK 



f{h)g{k) {p^{h)t\p^{k)t) dhdk 

Ho/HonK JHo/HonK 

{Uf\Ug). 



This proves (1). 
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(2) This follows from Lemma 10.4,7) and the following calculation: 

t/(7r,(s)/)l = j f{s-^h)p,{h)tdh 

= j f{h{s-^h))aH{s-^h)-'^''+P'>p^{h)tdh 

f{h{s'^h))aH{sh{s-^)f-Pp^(h)aH{s'^h)-'^Ptdh 



/■ 



f{h)p,,{sh)tdh 

= pAs)U{f) , 
where we have used that 

p^{sh)l = aH{shY-Pp^{h{sh))\ . 
(3) By (1) and (2) we get: 

\\Ms)frj = \\p.{s)U{f)r 

< \WU)\? 

= {f\[A{v)J]f)^ (=||/||2) . 

Thus 'Ki,{s) passes to a contractive operator on K. That 7f^(s)* = tTv{t{s)~^) 
follows from Lemma 10.11. □ 

Theorem 10.20 (Identification Theorem) . Assume that G/H is non-compactly 
causal and that u — p< L^os- Let pv, and 1 e Ky he as in Lemma 10.17. Then 
the following hold: 

1) There exists a continuous contractive representation it{v) of So{C) on K 
such that 

7r(j.)(s)* =7r(i/)(r(s)-i), Vs e 5„(C) . 

2) There exists a unitary representation nli'Y' of such that 

i) d^{vY{x) = d^{v){x) yx e f). 

ii) d^vYiiY) = i dTr{iy){Y) VF € C. 

3) The map 

extends to an isometry K ~ intertwining 7ir(i^)^ and p„. In particular 
Tt{i'y is irreducible and isomorphic to pv 

Proof. (1) follows from Lemma 10.19 as obviously 7f(z/)(sr) = TT{v){s)'kv{r). 

(2) This follows now from the Theorem of Liischer-Mack. 

(3) By Lemma 10.19 we know that / i— > U{f) defines an isometric So{C)- 
intcrtwining operator. Let / € C'^{Q.,v). Differentiation and the fact that Pv is 

holomorphic gives 

i) u{dT,{vY{x)f) = dp,{x)u{f) , yxet). 

ii) U{i dTT{vY{y)f) = i dp,{Y)U{f) , VF e C. 

But those arc exactly the relations that define Ti{vY ■ The fact that f) ® «C 
generates q'^ implies that f ^ U (/) induces an g'^-intertwining operator intertwining 
^{vY and Pv. As both are also representations of G'^, it follows that this is an 
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isometric C^-map. In particular as it is an isometry by Lemma 10.19, part 1, it 
follows that the map U is an isomorphism. This proves the theorem. □ 

Wc will now explain another view of the above results using local representa- 
tions instead of the Liischer-Mack Theorem. Let ttp be a maximal abelian subspace 
of p containing X^. Then Op is contained in q. Let A (0,0) be the set of roots 
of a in g. We choose a positive system such that A+ — {a | a(X°) = 1} C 
A+(fl, a). Choose a maximal set of long strongly orthogonal roots 71,..., 7^, 
r = rank{H/H n K). Choose Xj e such that with X-j = T{Xj) we have 
[Xj,X_j] = Hj := H^.. Then by Theorem 5.1.8 in [33] we have 



n = Ad{HnK) { "^tjX. 



l<tj<l,l<j<r 



For R>0, let 

Br := Ad{H nK){y^ tjX-j -R <tj <R 




Then Br is open in n. Let /?: Kq — > (Ko/N)~ = K be the canonical map. Then 



/? is a contraction (||/3(/)||^ = (/ 1 Jf) = (/ | f)j < \\f\f). For f/ c O open, let 

C:°{U,u) := {/ e C^{n,iy) I supp(/) C U} 

and K{U) := P{C^{U)). 

Theorem 10.21. Let U ClVL he open. Then K(;7) is dense in K. 

Proof. Let x € U. Then we can choose h & H such that h ■ x = 0. As 
C^{U,v) = h ■ C^{h ■ U,v) and H acts unitarily, it follows that we can assume 
that QeU. Let i? > be such that Br C U. Then C^{Br, v) C C^iU, v). Hence 
we can assume that U = Br. Let g G C^{U, v)^ and let / e Cj?°(f2, v). We want 
to show that {g \ f)j = 0. Choose < L < 1 such that supp(/) C Bl- For f e M 
and at — exp(2iX°) we have at • Bl = B^-it^. Thus supp([7r(i^)(a()/]j2) C 3^-21^. 
Choose < So such that e~^*L < R for every t > sq. Then n{i^){at){f ) G C^{U, v) 
for every t > Sq. It follows that for t > sq: 

= {g\n{iy){at)f)j 



n Jn 
= e(A+i)t 



5(2;) [w{v){at)f] {y)Qa{x,y) dxdy 



/ / g{.x)f{e^^y)Qa{x,y)dxdy 

Jn Jn 



= 6^^-''* / / g{x)f{y)Q4x,e-''y)dxdy. 
Jn Jn 

By Lemma 8.7 we know that z h^- Q{zX, Y) is holomorphic on D = {z \ \z\ < 1}. 
As g and / both have compact support it follows by (10.40) that 



Fi^) ■= / / 9{x)f{y)Q{x,zy)dxdy 
Jn Jn 

is holomorphic on D. But F{z) = for < 2; < e"^**". Thus F{z) = for every z. 
In particular 

{9\niu)iat)f)j = 
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for every t > 0. By continuity {g \ f)j = 0. Thus g = 0. □ 

Let us recall some basic facts from [41]. Let p be a local homomorphism of a 
neighborhood U of e in G into the space of hnear operators on the Hilbert space 
H such that p{g) is densely defined for g £ U. Furthermore p\(unH) extends to a 
strongly continuous representation of iJ in H. p is called a local representation if 
there exists a dense subspace D c H such that the following hold: 

LRl) e f/, D c D{p{g)), where D{p{g)) is the domain of definition for p{g). 

LR2) If gi,g2,gig2 € U and u e D then p{g2)u € 'D{p{gi)) and 

P{9i)[p{92)u] = p{gig2)u. 

LR3) Let F e [) such that exptF e J7 for < i < 1. Then for every u e D 

liin p(exp tY)u = u . 

LR4) p{Y)T> C D for every F e f). 

LR5) \/u G D 3Vu an open 1-neighborhod in H such that UVu C U"^ and p{h)u G 
D for every h (z Vu- 

LR6) For every F e q and every m G D the function 

h I — > p(exp(Ad(/i)y))u 

is locally integrable on {h G H \ exp(Ad(/i)F) e ?7}. 

[41] now states that every local representation extends to a unitary representation 

of G"^. We now want to use Theorem 10.21 to construct a local representation of 
G. For that let < i? < 1 and let D = K{Bfi{0)). Let V be a symmetric open 
neighborhood of 1 G G such that V ■ 5^(0) C O. Let Ui be a convex symmetric 
neighborhood of in g such that with U := cxpUi we have C V. If g E U 
then obviously (LRl) (LR3) are satisfied. (LR4) is satisfied as differentiation does 
not increase support. (LR6) is also clear as m = /?(/) with / e C^{U) and hence 
||pc(exp Ad(ft-)F)'u|| is continuous as a function of h. 

(LR5) Let u = /?(/) G K{Br{0)). Let L = supp(/) C Br{0). Let K be such 
that = Vu, VuL C Br{0), and Vu C [/. Then UVu C C/^ and 
f3{Tr{v){h)f ) is defined and in D. This now implies that tt restricted to [/ is a local 
representation. Hence the existence of tt'^ follows from [41]. We notice that this 
construction of ■k'^ does not use the full semigroup S but only H and expR+X". 

Remark 10.22. Here we have used reflection positivity to go from the gener- 
alized principal series to a highest weight module. Similar, but purely algebraic 
construction for the special case Gc and G^ = G x G is due to T. J. Enright, [9]. 

11. The Segal-Bargmann Transform 

We have seen that the reflection positivity and the Osterwalder-Schrader du- 
ality both correspond to transforming functions on the real form O C ilc to a 
reproducing Hilbert space of holomorphic functions on fie • A classical example of 
a similar situation is given by the Segal-Bargmann transform of the Schrodinger 
representation realized on L^(M") to the Fock model realized in the space of holo- 
morphic function on C" with finite norm 

\\nl= I \F{z)t e-\^\' d„{z) 



48 



PALLE E. T. JORGENSEN AND GESTUR 6LAFSSON 



where d/x is the 7r~" times the Lebesgue measure on C". We normalize the Lebesgue 
measure on R" by (27r)^"/^ times tlie usual Lebesgue measure. We denote the 
resulting measure by dx. There are no further constants in the Fourier inversion 
formula in this normalization. 

Our first observation is that C" is a "complexification" of M". Therefore the 
"restriction" map 

B : F(C") — > L2(R") , RF{x) := C'^^/^Fix) 

is injective. It can be shown that R is continuous with dense image. Hence 
R* : L2(R") F(C") is well defined and continuous. 

The next observation is, that F(C") is a reproducing Hilbert space with repro- 
ducing kernel K{iu,z) = Kz{w) ~ e™^. Therefore 

R*f{z) = {K,\R*f) 
= {RK. I /) 

= j f{x)e-''^'^e''=dx 

= e''/^ J f{x)e-^'-^^"/^dx 

(11.44) =e''/^H*f{z) 

where H{z) = e~^^/^. 

The third observation is that this is just a special case of the heat semigroup 

Ht{f){y) = Ht * f{y) = j /(x)e-(^-^)'/2* dx . 

As the name indicate the family {-fft}t>o is a semigroup, that is 

(11.45) Ht*H, = Ht+s. 



This gives us the following form for RR* and = \/RR*: 

RR*h{x) = e-^'/2^*/i(a;) 

(11.46) = iJi * h{x) . 
Thus 

(11.47) VRR*{h){x) = Hy2 * h{x) 

= 2"/2y h{y)e-^''-y^^ dy . 

Prom this we derive the following expression for the unitary part of the polar 
decomposition of R* = B\fRR* of R*: 

Bh{z) = R* \R*\~'^ h{z) 

= e'"'^Hy2 * h{z) 

= 2"/2y h{x)e-^"+^'^-''''^dy 

^2-/2e--V2y h{x)e--"+^^' dx 
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which is, up to a scaling factor, the usual Bargmann transform, see [13], p. 40. In 
particular it follows directly from our construction that the Bargmann transform 
is a unitary isomorphism. 

This example shows that we can recover the Bargmann transform from the 

restriction principle, see [78] , that is we have 

• Manifolds M C Mc where Mc is a "complexification" of M; 

• Groups H C G such that H acts on M and G acts on Mc; 

• Measures /i and A on M respectively Mc with the measure /i being H- 

invariant; 

• A reproducing Hilbert space F(Mc) C L-^(Mc, A) fl 0{Mc) with a represen- 
tation TTG of G given by 

[7VG{9)F]{z)=mig-\z)-'F{g-'-z) 

where m is a "multiplier" . 

• A function x such that the "restriction" map R{F){x) := x{x)F{x), x G M, 
from F(Mc) L^(M, /u) is a closed (or continuous) iJ-intertwining operator 
with dense image. 

Denote the reproducing kernel of F(Mc) by K{z,w) — Kw{z). Then € 
F(Mc) and K{z, w) = K{w,z). The map R* : L'^{M, ii) F(Mc) has the form 

R*h{w) ={Ky,\R*h) 

= {RK^ I h) 

(11.48) = / h{rn)x{Tn)K{w,rn) djiim) . 

Jm 

Hence 

(11.49) RR*h{x)= I h{m)x{x)x{m) K(x, m) dn{m) . 

Jm 

Write R* = B\R*\ for the polar decomposition of R*. 

Definition 11.1. The unitary isomorphism B: 'L'^{M,fi) — > F(Mc) is called 
the (generalized) Bargmann transform. 

The natural setting that we are looking at now is H/H (1 K ~ c G'^/K'^ = 
Oc and one of the highest weight modules as a generalization of the Fock spaces 
with the representation [p^{g)F]{Z) = Jx{g~'^, Z)-'^F{g-'^ ■ Z), see (8.11). Here A 
corresponds to — p in our previous sections. Define 

(11.50) i?F(x) = Ja(x,0)"^F(x • 0), x€H. 

Using the multiplier relation Jx{h~^x, 0) = J\{h~^ ,x-0)J\{x, 0) which follows from 
(7.3) we get: 

R [px{h)F] {x) = Mx, 0)-i [px{h)F] {x ■ 0) 

= Jx{x, 0)-'^Jx{h-^,x- oy^Fih-^ ■ {x ■ 0)) 

= Jx{h-^x,0)-'^F{{h-^x) ■ 0) 

= [L{h)RF]{x) 

where L stands for the left regular representation of H on H/H n K. Hence R is 
an intertwining operator. Let ap, A and A+ be as in the end of Section 10. By 
[75, 76] the following is known: 
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Theorem 11.2. Suppose that {\ + p,Ha) < for all a e A+. Then p\ is 
equivalent to a discrete summand in h'^{G'^/H), that is there exists an infective 
C-map T: U{px) ^ l^iC/H). 

We call the resulting discrete part of L^(G'^/if) the holomorphic discrete series 
of C/H. We have (see [78]): 

Theorem 11.3. Assume that p\ is a holomorphic discrete series representation 
ofC^/H then the following holds: 

(i) The restriction map is injective, closed and, with dense image. 

(ii) The generalized Bargmann transform B : L,^{H/H n K) H{px) is a H- 
isomorphism. 

Denote as before the reproducing kernel of tl{p\) by Q{W, Z). Then by (11.48) 
and Theorem 8.7: 

R*f{Z)= [ f{h ■ 0) • Jx{h, 0)-iQ(/i • 0, Z) dh 

J H/HnK 

(11.51) = / f{h-0)Jx{h-^,Z)dh. 

JH/HnK 

li Z = x-0, X e H, then JxihrK Z) = Jxih-'^x,0)J{x,Oy\ Let ^x{h) := Jx{h,0) 
and view /(/i • 0) as a right H n iiT-invariant function on H. Then RR* is the 
convolution operator 

RR*f{x)= f f{h)^x{h~^x)dh. 

JH 

The problem that we face here is, that A ^ \1/a* is not a semigroup of operators. 
Hence it becomes harder to find the square root of RR*, but it can still be shown, 

that it is a convolution operator. The final remark in this section is the following 
connection between our map U that comes from the reflection positivity and R* . 

Theorem 11.4. Let f e C^{VL,v). Define a function F on H/HnK by F{h) = 
ajvW"""''/('i-oppO). Then 

Uf{Z) = R*{F){Z). 
Proof. This follows from (11.51) and (10.43) □ 

12. The Heisenberg Group 

A special case of the setup in Definition 3.1 above arises as follows: Let the 
group G, and t G Aut2(G) be as described there. Let H± be two given complex 
Hilbert spaces, and tt± G Rep(G, H±) a pair of unitary representations. Suppose 
T : H_ — > H+ is a unitary operator such that Tw- = (7r+ o r) T, or equivalently, 

(12.1) T7r_(ff)/_=7r+(T(ff))T/_ 

for all g G G, and all /_ e H_. Form the direct sum H := H+ ® H_ with inner 

product 

(12.2) (/+ ©/_!/;© f'_) := (/+ 1 + (./- 1 /:)_ 

where the ± subscripts are put in to refer to the respective Hilbert spaces H±, and 
we may form tt := 7r+ ® 7r_ as a unitary representation on H = H+ ® H_ by 

n{g) (/+ e /-) = 7r+(ff)/+ 8 n-{g)f- , 5 e G, /± e H± . 
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Setting 

(12.3) J := 



T 
T* 



that is J (/+ ® /_) = (r/_) {T*f+), it is tlicn clear that properties (l)-(2) from 
Definition 3.1 will be satisfied for the pair (J, tt). Formula (12.1) may be recovered 
by writing out the relation 

(12.4) J7r=(7r or) J 

in matrix form, specifically 

T\ fn+{g) \ _ /7r+(T(5)) W T 
T* Oj{ n_ig)J \ n_{T{g))J \t* 

If, conversely, (12.4) is assumed for some unitary period-2 operator J on H = 
H+ © H_, and, if the two representations 7r+ and 7r_ are disjoint, in the sense that 
no irreducible in one occurs in the other (or, equivalently, there is no nonzero in- 
tertwiner between them), then, in fact, (12.1) will follow from (12.4). The diagonal 
terms in (12.3) will be zero if (12.4) holds. This last implication is an application 
of Schur's lemma. 

Lemma 12.1. Let ^ Kg be a closed linear subspace o/H = H+ ® H_ satis- 
fying the positivity condition (PR3) in Definition 3.2, that is 

(12.5) {v\Jv)>0, Vve Ko 
where 



(12.6) J = 



T 

T* 



is given from a fixed unitary isomorphism T: H_ H_|_ as in (12.1). For v = 
/+ ® /_ g H = H+ ® H_, set P+v := /+. The closure of the subspace P+Kq in 
H+ will be denoted P+Kq. Then the subspace 



10+) eKo /_eT*(P+Ko)| 



is the graph of a closed linear operator M with domain 

(12.7) D = |/+eH+ 3/_ e T* (P^) s.t. j;+) e Ko I ; 

and, moreover, the product operator L := TM is dissipative on this domain, that is 

(12.8) I /+)+ + (/+ I L/+)+>0 

holds for all /+ e D. 

Proof. The details will only be sketched here, but the reader is referred to 
[100] and [40] for definitions and background literature. An important argument 

in the proof is the verification that, if a column vector of the form (?) is in G, 



J- 

then /_ must necessarily be zero in H_ . But using positivity, we have 
(12.9) \{u\Jv)f <{u\Ju){v\Jv) , Vu,weKo. 



52 



PALLE E. T. JORGENSEN AND GESTUR 6LAFSSON 



Using this on the vectors u = [ ^ j and v = (^'^ ] G Kq, we get 



f Tk^ 



(/_|T*fc+) =0, yk+ = P+v. 



But, since /_ is also in T* (P+Kq) , we conclude that /_ = 0, proving that G is the 
graph of an operator M as specified. The dissipativity of the operator L = TM is 
just a restatement of (PR3). □ 

The above result involves only the operator-theoretic information implied by 
the data in Definition 3.2, and, in the next lemma, we introduce the representations: 

Lemma 12.2. Let the representations Tr± and the intertwiner T be given as 
specified before. Let H = ; and suppose we have a cone C C q as specified in 
(PRl), (PR2') and (PES'). Assume further that 

PR4) D is dense in H+; 

PR5) The commutant of tt{H) is abelian. 

Then L = TM is normal. 

Proof. Since T is a unitary isomorphism H_ — > H+ we may make an iden- 
tification and reduce the proof to the case where H_|_ = H_ and T is the identity 
operator. We then have 

7r_ = (7r+ o r) T = 7r+ o r ; 

and ii h & H, then 

7r_(/i)=7r+ {T{h))=n+{h); 

while, if T{g) = g~^, then 

-^-(9) = 7!"+ (rig)) = 7r+ (g'^) . 

Using only the H part from (PR2'), wc conclude that Kg is invariant under 7r+ © 
7r_|_(if). If the projection Pko of ® onto Kq is written as an operator matrix 

-Pll -Pl2 



P21 P22 



with entries representing operators in H_|_, and satisfying 



p* 

Al 


= Pll, 


p* 
-'22 


= P22, 


P* 


= P21, 


Pij 


= PilP] 



Pi2P2j , 

then it follows that 

(12.10) Pt:in+ih) = Tr+ih)P,j Vi,j = l,2,yheH, 

which puts each of the four operators Pij in the commutant ^^{Hy from (PR5). 
Using (PR4), we then conclude that L is a dissipative operator with D as dense 
domain, and that Kg is the graph of this operator. Using (PR5), and a theorem 
of Stone [100], we finally conclude that L is a normal operator, that is it can be 
represented as a multiplication operator with dense domain D in H+. □ 
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We shall consider two cases below (the Heisenberg group, and the {ax + b)- 
group) when conditions (PR4) (PR5) can be verified from the context of the rep- 
resentations. Suppose G has two abelian subgroups H, N, and the second N also 
a normal subgroup, such that G = HN is a product representation in the sense of 
Mackey [61]. Define r e Aut2(G) by setting 

(12.11) T{h)=h, e H , and T{n) = n-^ , VneiV. 

/I a c\ 

The Heisenberg group is a copy of M"^ represented as matrices I 1 6 1 , or 

\0 1/ 

equivalently vectors (a, b, c) e K^. Setting H = {{a, 0, 0) | a e M} and 

(12.12) N = {{0,b,c)\b,cGR} , 
we arrive at one example. 

The {ax + 6)-group is a copy of M? represented as matrices ^ a = e^, 



6 e M, s e R. Here we may take H = 



a 
1 



a e M+ > and 



(12.13) N 



1 b 
1 



be 



and we have a second example of the Mackey factorization. Generally, if G = HN 

is specified as described, we use the representations of G which are induced from 
one-dimensional representations of N. If G is the Heisenberg group, or the (aa;-|-6)- 
group, we get all the infinite-dimensional irreducible representations of G by this 
induction (up to unitary equivalence, of course). For the Heisenberg group, the 
representations are indexed by fi S M \ {0}, fi denoting Planck's constant. The 
representation tt/j may be given in H = L^(M) by 

(12.14) 7rfi(a, b, c)f{x) = e''^(^+^-)/(a; + a) , V/ e L^{R), {a, b,c)eG. 

The Stone-von Neumann uniqueness theorem asserts that every unitary represen- 
tation TT of G satisfying 

^(0,0,c) = e^'^^/HW (fiv^O) 
is unitarily equivalent to a direct sum of copies of the representation irn in (12.14). 

alent unitary irreducible representations, and they may also be given in the same 
Hilbert space L'^{R) by 

(12.15) 7r±(^g J^/(x) = e±-^V(2: + s), V/gL2(R). 

There are many references for these standard facts from representation theory; see, 
e.g., [43]. 

Lemma 12.3. Let the group G have the form G — HN for locally compact 
abelian subgroups H,N, with N normal, and H n N = {e}. Let x be a one- 
dimensional unitary representation of N , and let tt = ind^(x) be the corresponding 
induced representation. Then the commutant of {^{H) \ h G H} is an abelian von 
Neumann algebra: in other words, condition (PR5) in Lemma 12.2 is satisfied. 



The {ax + 6)-group (in the form 



s, 6 G M >) has only two inequiv- 
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Proof. See, e.g., [43]. □ 

In the rest of the present section, we will treat the case of the Heisenberg group, 
and the {ax + b) -group will be the subject of the next section. 

For both groups wc get pairs of unitary representations tt± arising from some 
r G Aut2(G) and described as in (12.4) above. But when the two representations 7r+ 
and TT- = TT+OT are irreducible and disjoint, we will show that there are no spaces 
Ko satisfying (PRl), (PR2'), and (PR3) such that K = (Kq/N)'" is nontrivial. 
Here (PR2) is replaced by 

PR2') C is a nontrivial cone in q. 

Since for both groups, and common to all the representations, we noted that the 
Hilbert space H_|_ may be taken as L^(]R), we can have J from (12.6) represented in 

the form J = ( ^ n ) • Then the J-inner product on H+ H_ = L2(M) L2(M) ~ 



I, C^) may be brought into the form 



(12.16) ^0+) 0+)^^ = 2 Re (/+!/_) = 2 1" Re (/+(x)/_(a;)) dx . 

For the two examples, we introduce 

N+ = {{0,b,c)\b,cGR+} 
where N is defined in (12.12), but 7V+ is not //-invariant. Alternatively, set 



N+ 



1 b 
1 



be 



for the alternative case where N is defined from (12.13), and note that this is 
if-invariant. In fact there arc the following 4 invariant cones in q: 

c+ = mo,t)\t>o} 
cr = {(o,o,i)|t<o} 

C+ = {iO,x,y)\x€R, y>0} 
= {{0,x,y)\xGR, y<0} 

Let TT denote one of the representations of G = HN from the discussion above (see 
formulas (12.14) and (12.15)) and let P be a closed subspace of H = L^(M) which 
is assumed invariant under Tr{HN+). Then it follows that the two spaces 

(12.17) Doo := V Mn)'D \ n G N} 

(12.18) D_oo := A Mn)'D \ n G N} 

are invariant under 7r(G), where the symbols V and /\ are used for the usual lattice 

operations on closed subspaces in H. We leave the easy verification to the reader, 
but the issue is resumed in the next section. If .Poo; resp., P—qq^ denotes the 
projection of H onto T>oo, resp., V-^, then we assert that both projections P±oo 
arc in the commutant of 7r(G). So, if tt is irreducible, then each Poo, or P-oo, must 
be or /. Since P-oo C V C V^o from the assumption, it follows that Poo = / if 
V ^ {0}. 
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Lemma 12.4. Let G he the Heisenherg group, and let the notation he as de- 
scribed above. Let 7r+ be one of the representations Tin and let 7r_ be the corre- 
sponding 7r_fi representation. Let ^ Kq C (R) © (R) he a closed suhspace 
which is invariant under (7r+ © 7r_) (iJiV+). Then it follows that there are only 
the following possibilities for P+Kg." {0}, L^(R), or A'H+ where 7i+ denotes the 
Hardy space in L^(IR) consisting of functions f with Fourier transform f supported 
in the half-line [0, oo), and where A e L°°(R) is such that |^(a;)| = la.e. x e K. 
For the space P_Ko, there are the possibilities: {0}, L^(R), and AH-, where A 
is a {possibly different) unitary h'^ -function, and H- denotes the negative Hardy 
space. 

Proof. Immediate from the discussion, and the BeurUng-Lax theorem classi- 
fying the closed subspaccs in L^(R) which are invariant under the multiplication 
operators, f{x) i— > e*°^/(a;), a £ R+. We refer to [59], or [29], for a review of the 
Beurling-Lax theorem. □ 

Corollary 12.5. Let 7r± he the representations of the Heisenherg group, and 
suppose that the suhspace Kq from Lemma 12.4 is chosen such that (PR1)-(PR3) 
in Definition 3.2 hold. Then {Ko/N)~ = {0}. 

Proof. Suppose there are unitary functions A± G L°°(R) such that P±Ko = 
A±Ti±. Then this would violate the Schwarz-estimate (12.9), and therefore condi- 
tion (PR3). Using irreducibility of 7r+ = ttr and of 7r_ = 7r+ o r = 7r_/j, we may 
reduce to considering the cases when one of the spaces P±Ko is L^(R). By Lemma 
12.2, we are tlien back to the case when Kq or Kq ^ is the graph of a densely defined 
normal and dissipative operator L, or L~^, respectively. We will consider L only. 
The other case goes the same way. Since 

(12.19) (^+e^_)(0,5,0)(/+®/_)(x) = e''''^^/+(a;)®e-«''^/_(,x) 

it follows that L must anti-commute with the multiplication operator ix on L^(R). 
For deriving this, we used assumption (PR3) at this point. We also showed in 
Lemma 12.2 that L must act as a multiplication operator on the Fourier-transform 
side. But the anti-commutativity is inconsistent with a known structure theorem 
in [88], specifically Corollary 3.3 in that paper. Hence there are unitary func- 
tions A± in L°°(IR) such that P±Ko = A±Ti±. But this possibility is inconsistent 
with positivity in the form Re(/+|/_) > 0, V(/+,/_) G Kq (see (12.16)) if 
(Ko/N)"' 7^ {0}. To see this, note that Kq is invariant under the unitary operators 
(12.19) for b G M+. The argument from Lemma 12.4, now applied to 7r+ ® 7r_, 
shows that the two subspaces 

KS° := V (7r+©7r_)(0,6,0)Ko 

and 

Ko"°° := /\{n+(Bn-){0,b,0)Ko 

are both invariant under the whole group (77+ © 7r_) (G). But the commutant of 
this is 2-dimensional: the only projections in the commutant are represented as one 
of the following, 

(0 U) -(J) S) ' (0 f) ' °^ (J) ?) ' 
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relative to the decomposition li (M) ® (R) of 7r+ ® 7r_ . The above analysis of the 

anti-commutator rules out the cases ^ ^ and , and if (Kq/N)"' ^ {0}, 

we are left with the cases Kg° = {0} and Kff = L'^{R) ® L'^{M.). Recall, generally 
K^°° C Ko C Kg°, as a starting point for the analysis. A final application of the 
Beurling-Lax theorem (as in [59]; see also [8]) to (12.19) then shows that there 
must be a pair of unitary functions A± in L°° (K) such that 

(12.20) Ko = A+n+ ® A-H- 

where Tl± arc the two Hardy spaces given by having / supported in [0,00), re- 
spectively, (—00,0]. The argument is now completed by noting that (12.20) is 
inconsistent with the positivity of Kq in (12.5); that is, we clearly do not have 



A-h- 



J y^^^'^J y = 2 Re {A+h+ \ A^h-) semidefinite, for all h+ e H+ and 
all h- e H- . This concludes the proof of the Corollary. □ 

Remark 12.6. At the end of the above proof of Corollary 12.5, we arrived 

at the conclusion (12.20) for the subspace Ko under consideration. Motivated by 
this, we define a closed subspace Kq in a direct sum Hilbert space H+ © H_ to be 
uncorrelated if there are closed subspaces D± c H± in the respective summands 
such that 

(12.21) Ko = D+©D_ 

Contained in the corollary is then the assertion that every semigroup-invariant Kq 
in L^(M) © L^(R) is uncorrelated, where the semigroup here is the subsemigroup S 
in the Heisenberg group G given by 

(12.22) 5 = {(o,6,c) I 6 e M+, a,c€ M} , 

and the parameterization is the one from (12.12). We also had the representation 
TT in the form 7r+ ® 7r_ where the respective summand representations tt± of G 
are given by (12.14) relative to a pair (H, — fi), fi G M \ {0} some fixed value of 
Planck's constant. In particular, it is assumed in Corollary 12.5 that each repre- 
sentation 7r± is irreducible. But for proving that some given semigroup-invariant 
Kq must be uncorrelated, this last condition can be relaxed considerably; and this 
turns out to be relevant for applications to Lax-Phillips scattering theory for the 
wave equation with obstacle scattering [59]. In that context, the spaces D± will 
be outgoing, respectively, incoming subspaces; and the wave equation translates 
backwards, respectively forwards, according to the unitary one-parameter groups 
7r_ (0,6,0), respectively, 7r+ (0,6,0), with b gM. representing the time- variable t for 
the unitary time-evolution one-parameter group which solves the wave equation 
under consideration. The unitary-equivalence identity (12.4) stated before Lemma 
12.1 then implies equivalence of the wave-dynamics before, and after, the obstacle 
scattering. 

Before stating our next result, we call attention to the (2n + l)-dimensional 
Heisenberg group Gn in the form M^"+^ = M" x M" x M, in parameter form: a,b G 
M", c e M, and product rule 

(a, b, c) • (a', b', c') = {a + a' ,b + b' ,c + c' + a- b') 



UNITARY REPRESENTATIONS AND O-S DUALITY 



57 



where a + a' = {ai + a[, . . . ,an + a'^) and a ■ b' = J2]j=i ^j^'j- ^or every (fixed) 
6 e M" \ {0}, we then have a subsemigroup 

(12.23) S{b) = {{a,Pb,c) \ P eR+, ae M", c e M} ; 

and we show in the next result that it is enough to have invariance under such a 
semigroup in G„, just for a single direction, defined from some fixed 6 € M" \ {0}. 

Theorem 12.7. Let tt± he unitary representations of the Heisenherg group G 
on respective Hilbert spaces H±, and let T: H_ H_|_ be a unitary isomorphism 
which intertwines tt- and 7r+ o r as in (12.1) where 

(12.24) T{a,b,c) = {a,-b,-c), V(a, 6, c) e G ~ 
Suppose there is H G'M. \ {0} such that 

(12.25) 7r+(0,0,c) = e«^/H+. 

// Ko C H+ © H_ is a closed subspace which is invariant under 

{{n+®n^){a,(3b,c) | a G K", /3 e K+, c G K} 

from (12.23), b € M" \ {0}, then we conclude that Kq must automatically be uncor- 
related. 

Proof. The group-law in the Heisenberg group yields the following commu- 
tator rule: 

(a, 0, 0)(0, b, 0)(-a, 0, 0) = (0, b,a-b) 

for all a,b G M". We now apply tt = tt^ ® 7r_ to this, and evaluate on a general 
vector /+ ® /_ e Ko C H+ ® H_: abbreviating 7r(a) for 7r(a, 0,0), and 7r(6) for 

7r(0, b, 0), wc get 

7r(a)7r(/36)^(-a)(/+ /_) = e*''- V(/?&)/+ ® e-^^^^'V. (/35)/_ e Kq 

valid for all a G R", /3 G M+. Note, in (12.25), we are assuming that 7r+ takes 
on some specific value e^^" on the one-dimensional center. Since 7r_ is unitarily 
equivalent to 7r+ o r by assumption (see (12.25)), we conclude that 

7r_(0,0,c) = e-'^^/H_ , VceK. 

The argument really only needs that the two representations tt± define different 
characters on the center. (Clearly h ^ —h since h ^ 0.) Multiplying through first 
with e"'^'^" '', and integrating the resulting term 

7r+(/36)/+ ® e-*2«/3«-''7r_(/36)/_ e Kq 

in the a-variable, we get 7r+(/36)/+ © G Kq. The last conclusion is just using that 
Ko is a closed subspace. But we can do the same with the term 

e'2'^^«-^+(/36)/+ © 7r_(/36)/_ e Kq , 

and we arrive at © 7r_(/36)/_ e Ko. Finally letting /? — > 0+, and using strong 
continuity, we get /+ffiO and Offi/_ both in Kq. Recalling that f± are general vectors 
in P±Ko, we conclude that P+Ko©P_Ko C Kq, and therefore P+Ko©P_Ko C Kq. 
Since the converse inclusion is obvious, we arrive at (12.21) with D± = P±Ko. □ 
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The next result shows among other things that there are representations tt of 

the Heisenberg group Gn (for each n) such that the reflected representation 7r° 
of GJj ~ Gn (see Theorem 6.2) acts on a nonzero Hilbert space H'^ = (Ko/N)"". 
However, because of Lemma 6.3, -k'^ (G^) wih automatically be an abelian group 
of operators on H"^. To sec this, note that the proof of Theorem 12.7 shows that 
tt'^ must act as the identity operator on H'= when restricted to the one-dimensional 
center in GJ; ~ G„. 

It will be convenient for us to read off this result from a more general context: 
we shall consider a general Lie group G, and we fix a right-invariant Haar measure 
on G. 

A distribution F on the Lie group G will be said to be positive definite (PD) if 
(PD) / / F{uv-'^)j{ujf{v)dudv>0 

JG JG 

for all / e C^{G); and we say that F is PD on some open subset c G if this 
holds for all / S G^(ri). The interpretation of the expression in (PD) is in the 
sense of distributions. But presently measurable functions F will serve as the prime 
examples. 

We say that the distribution is refiection-positive (RP) on O ((RPq) for em- 
phasis) if, for some period-2 automorphism r of G, we have 

(12.26) FoT = F 

and 

(RPo) / / F{T{u)v-^)J{u)f{v)dudv>0 

JG JG 

for all / e C^ifl). 

We say that a; e G is (RPo)-contractive if (RPo) holds, and for all / G G~(r2) 
0< / / F{T{u)v-^)J{^f{vx)dudv 

JG JG 

< I I F{T{u)v-'^)f{u)f{v)dudv. 

JG JG 

Note that, since 

/ / F{T{u)v-^)J(^f{vx)dudv = I I F{T{u)T{x)-^xv-^)J{u)f{v)dudv 

JG JG JG JG 

it follows that every x E H is contractive; in fact, isometric. If instead we have 
t{x) = x^^, then contractivity amoimts to the estimate 

/ / F{T{u)x'^v-^)J(u)f{v)dudv < [ [ F{T{u)v-^)J(u)f{v)dudv 

JG JG JG JG 

for all / € G^(0). Using the Basic Lemma one can also show that x acts by 
contractions. 

The following result is useful, but an easy consequence of the definitions and 
standard techniques for positive definite distributions; see for example [43, 91]. 

Theorem 12.8. Let F be a distribution on a Lie group G with a period-2 au- 
tomorphism T, and suppose F is T-invariant, (PD) holds on G, and (RPo) holds 
on some open, and semigroup-invariant, subset Q, in G. Then define 

{7r{u)f){v) := fivu) , yu,v & G, V/ e G-(G) ; 



UNITARY REPRESENTATIONS AND O-S DUALITY 



59 



and 

Jf :=/oT. 

Let H(F) be the Hilbert space obtained from the GNS construction, applied to (PD), 
with inner product on (G) given by 



{f\9)-= / F{uv-')fiu)g{v)dudv. 
Jg Jg 

Then it extends to a unitary representation of G on H(i^), and J to a unitary 
operator, such that 

Jtt = (tt o t) J . 

// (RPn) further holds, as described, then tt induces {via Theorem 6.2) a unitary 
representationn" ofG'' acting on the new Hilbert space H'^ obtained from completing 
in the new inner product from (RPq), and dividing out with the corresponding 
kernel. 

The simplest example of a function F on the Heisenberg group Gn satisfying 
(PD), but not (RPo), for nontrivial fi's, may be obtained from the Green's function 
for the sub-Laplacian on Gn', sec [99, p. 599] for details. 

If complex coordinates are introduced in G„, the formula for F takes the fol- 
lowing simple form: let 2; € C", c e M, and define 

Fiz,c) 



(\zf+c^) 

Then we adapt the product in G„ to the modified definition as follows: 

{z, c) • {z', c') = {z + z',c + c' + {z, z')) \/z, z' e C", Vc, c' e K , 
where {z, z') is the symplectic form 

{z,z') := 2Im{z ■ z') . 
The period-2 automorphism r on G„ we take as 

t{z, c) = {z, -c) 

with z denoting complex conjugation {zi,. . . , Zn) 1— > (^1, . . . , ^„). 

The simplest example where both (PD) and (RPn) hold on the Heisenberg 
group Gn is the following: 

Example 12.9. Let C = (Ci) • • • Cn) € C", = ReCj, r?j = ImCj, j = 1, • . • , n. 
Define 

r giRe(2<) 

F{z, c)= „ d^i--- din dm-- - dvn ■ 

Let Q, := {{z,c) e Gn \ z = (2^)7=1, Imzj > 0}. Then (PD) holds on G„, 

and (RPjj) holds, referring to this fl. Since the expression for F{z,c) factors, the 
problem reduces to the (n = 1) special case. There we have 



F{z,c)= d^dr}; 

V + r + 1 
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and if / G C^in) with Q = {{z, c) \ y > 0}, then 
/ / F{T{u)v-^)J{u)f{v)dudv 

JGi JGi 



r ^i(x-x')i Q-i{y+v')v 



„ „ f(x + iy,c)f(x' + iy',c')dS,dridxdydcdx'dy'dc'. 

+ 77^ + 1 



Let / denote the Fourier transform in the x- variable, keeping the last two variables 
{y, c) separate. Then the integral transforms as follows: 



/ 

Jr 



e 



-f{^,y,c)f{^,y',c')d^dydy'dcdc'. 



Introducing the Laplace transform in the middle variable y, we then get (since / is 
supported in y > 0) 

r e-y^m, y, c) dy = fx{^, ^/l + e, c) ; 
^0 

the combined integral reduces further: 

which is clearly positive; and wc have demonstrated that (RPn) holds. It is imme- 
diate that F is T-invariant (see (12.26)), and also that it satisfies (PD) on G„. 

13. The {ax + 6)-Group Revisited 

We showed that in general we get a unitary representation tt'^ of the group C 
from an old one tt of G, provided tt satisfies the assumptions of refiection positivity. 
The construction as we saw uses a certain cone C and a semigroup H exp C, which 
are part of the axiom system. What results is a new class of unitary representations 
TT^ satisfying a certain spectrum condition (semi-bounded spectrum). 

But, for the simplest non-trivial group G, this semi-boundedness turns out not 
to be satisfied in the general case. Nonetheless, we still have a reflection construction 
getting us from unitary representations tt of the {ax + 6)-group, such that tt o t ~ tt 
(unitary equivalence), to associated unitary representations tt"^ of the same group. 
The (up to conjugation) unique non-trivial period-2 automorphism r of G, where 
G is the {ax + 6)-group, is given by 

T{a,b) = {a,-b). 

Recall that the G may be identified with the matrix-group 

'^a 



1 



a > 0,6 G 



and (a, b) corresponds to the matrix ^ ^ . In this realization the Lie algebra of 
G has the basis 

X=(l 0) and Y=(^^ I 

We have exp(tX) = (e*, 0) and exp(sr) = (1, s). Hence t{X) = X and t{Y) = -Y. 
Thus f) = MX and q = RY. We notice the commutator relation [X, Y] = Y. The 
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possible i7-invariant cones in q are ±{tY \ t > 0}. It is known from Mackey's 

theory that G has two inc'quivalcnt. unitary, irreducible, infinite-dimensional repre- 
sentations Tr± , and it is immediate that we have the unitary equivalence (see details 
below): 

(13.1) TT-i- o r ~ 7r_ . 

Hence, if we set tt := 7r+ ® 7r_, then tt o r ~ tt, so we have the setup for the 
general theory. We show that tt may be reahzed on L^(R) ® L^(R) ~ L^(R,C^), 
and we find and classify the invariant positive subspaces Kq C L^(]R, C^). To 
understand the interesting cases for the {ax + 6)-group G, we need to relax the 
invariance condition: We shall not assume invariancc of Kq under the semigroup 
{7r(l, b) \ b> 0}, but only under the infinitesimal unbounded generator ■jt{Y). With 
this, we still get the correspondence tt h- > tt^^ as described above. 

We use the above notation. We know from Mackey's theory [61] that there arc 
two inequivalent irreducible infinite-dimensional representations of G, and we shall 
need them in the following alternative formulations: Let jC± denote the respective 
Hilbcrt space L^(]R±) with the multiplicative invariant measure d^± = dp/\p\, 
p e M± . Then the formula 

(13.2) / ^ e^P'fipa) 

for functions / on M restricts to two unitary irreducible representations, denoted by 
w± of G on the respective spaces £±. Let Q{f ){p) ■— f{~p) denote the canonical 
mapping from £+ to or equivalently from £_ to C+. Then we have iov g G G 
(cf. (13.1)): 

(13.3) QTT+ig)=Tr-{Tig))Q 

For the representation tt := 7r+ © tt- on H := £+ © £_ we therefore have 

(13.4) Jnig) ^ 7T{T{g))J, geG, 
where J is the unitary involutive operator on H given by 



(13.5) 



Q 
Q 



Instead of the above p-realization of tt we will mainly use the following x- 

formalism. The map t ±e* defines an isomorphism L± : C± —> L^(]R), where we 
use the additive Haar measure dx on M. For g — {e'' ,b) G G and / € L^(R), set 

(13.6) (7r±(.g)/)(.T) :=e±"''^/(a; + s), xeR. 

A simple calculation shows that L± intertwines the old and new construction 
of 7r±, excusing our abuse of notation. In this realization Q becomes simply the 
identity operator Q{f){x) = f{x). The involution J: L^(M, C^) is now simply given 

by 

(13.7) J(/o,/i) = (/i,/o) 

In this formulation the operator 

(13.8) L:=7r±(AH- Aq) =7r±(X2-y2 
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takes the form 

^ 

but it is on L^(IR) and — oo < x < oo. This operator is known to have defect indices 
(1, 0) [39, 69], which means that it cannot be extended to a selfadjoint operator on 
L^(R). Using a theorem from [39, 92] we can see this by comparing the quantum 
mechanical problem for a particle governed by — L as a Schrodinger operator (that 
is a strongly repulsive force) with the corresponding classical one governed (on each 
energy surface) by 

2 



'dxV 

-Ekin + E^ot ~'"^) — e ^ = E . 



The escape time for this particle to a; = ±oo is 
(13.10) t± 



dx 



/finite VE + ^ 

that is too is finite, and t-oo = oo. We elaborate on this point below. The nonzero 

defect vector for the quantum mechanical problem corresponds to a boundary con- 
dition at a; = oo since this is the singularity which is reached in finite time. 

The fact from [39] we use for the defect index assertion is this: The Schrodinger 
operator = — (^) + V{x) for a single particle has nonzero defect solutions 
f± G L^(IR) to H*f± = ±if± iff there are solutions t x{t) to the corresponding 
classical problem 

with finite travel-time to a; = +00, respectively, x = —00. The respective (possibly 
infinite) travel-times are 

dx 



Jfir 



/finite ^/E- V{x) 

The correspondence principle states that one finite travel-time to -|-oo (say) yields 
a dimension in the associated defect space, and similarly for the other travel-time 
to —00. 

In the a;-formalism, (13.3) from above then simplifies to the following iden- 
tity for operators on the same Hilbert space (M) (carrying the two inequivalent 
representations 7r+ and 7r_): 

(13.11) 7r+(5) = 7r_(T(<?)), geG. 

We realize the representation tt = 7r+®7r_ in the Hilbert space H = L^(R)®L^(R) = 
L^(X2) where X2 = OxMUlxR. We may represent J by an automorphism 
0: X2 X2 (as illustrated in Proposition 4.3): 

9{0,x) ■.= {!, x) and 0(1, y) = (0, y) , x,yeR, 

and 

J{f){uj)=f{0{Lo)), UJGX2. 

Notice that the subset 

X^ = {oj€X2\ 9{uj) = uj] 
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is empty. Define for / e L^(X2), fk{x) = f{k,x), k = 0,1, x G R. We have for 
g={e',b)eG: 

(7r(5)/)o (x) = e^'^'foix + s) = {n+{g)fo){x) 

and 

{n{g)f), {x) = e-^'^'Mx + s) = {7t-{g)h){x) . 

Proposition 13.1. Let tt = 7r+ ® 7r_ be the representation from (13.1)-(13.4) 

above of the {ax + b) -group G. Then the only choices of reflections Kq as in Remark 
3.3 for the sub-semigroup S = {{a,b) £ G | 6 > 0} will have K = (Kq/N)"" equal 
to 0. 

Lemma 13.2. Let Q be the projection in L^(]R) ® L^(]R) onto a translation- 
invariant J -positive subspace. Then Q is represented by a measurable field of 2x2 
complex matrices M 9 ^ i-^- (Qii(0)ij=i ■'^c/i that |Qi2(C)l^ = Qii(0Q22(0 a.e. on 
M, and Qi2{£,) + Q2i{£,) > a.e.; and conversely. 

Corollary 13.3. These relations imply the following for the matrix Q: 
1) If Qi2{C) — ih^''^ W6 have the three possibilities: 



Q(0 = 




1 



In all those cases, we have Q{£,)JQ{S,) = 0. 
2) //Qi2(0 7^0, thenO< Q22(0 = 1-Qii(0 < 1- Let f,{0 = Qi2(0/Qii(0- 
Then by Tr{Q{^)JQ{^)) >0 we have Re/i(^) > and 

(13.12) Q(0 - 1 M M(0 



i + vm(c) iMor 

With X = p. we get that the image of Q{^) is given by 



Specifying to our situation, f = l^f ] € Kq if and only if 



(13.13) .fiiO = m.fo{o ■ 

Since Q{^) is a measurable field of projections, the function M 9 ^ A(^) 
must be measurable, but it may be unbounded. This also means that Pkq is the 
projection onto the graph of the operator To : /o i-^ /i where /o and /i are related 
as in (13.13), and the Fourier transform • is in the L^-sense. 

The following argument deals with the general case, avoiding the separation 
of the proof into the two cases (I) and (II): If vectors v G Kq are expanded 

as V = [k)' ^ ~ Qnh + Qi2k, k = Q2ih + Q22k, we can introduce V = 
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3k e L2 



Is.t. 



G N L If 6 > 0, then: 



Tr+{b)h = Qn-K+{b)h + Qi2'n-+{-b)k , 
7r+(-6)fc = (52i7r+(6)/i + (5227r+(-6)fc , 



valid for any 



G Ko, and b G 



So it follows from Lemma 4.1 again 



that 2? is invariant under {7r+(6) | 6 > 0}, and also under the whole semigroup 
{'jT+{g) \ g G S} where w+ is now denoting the corresponding irreducible represen- 
tation of G on L2(M). Let 



(13.14) 
(13.15) 



Poo := y Tr+{b)V, 
P_oo := /\n+{b)V, 



6GK 



where \/ and /\ denote the lattice operations on closed subspaces in L^( 
(7r+(6)/) {x) = e*^7(a;) , / G L2(R), b,xeR. 



and 



We may now apply the Lax-Phillips argument to the spaces I?±oc- If (Ko/N)'~^ 
should be ^ {0}, then T> = {0} by the argument. Since we are assuming (Kq/N)" ^ 
{0}, we get T) = {0}, and as a consequence the following operator graph representa- 
tion for Kq: (Kq/N)'^ = /? {G{L)) where G{L) is the graph of a closed operator L 

in L (K). Specifically, this means that the linear mapping Ko/N B (^^+N^h 

is well-defined as a linear closed operator. This in turn means that Kq may be 
represented as the graph of a closable operator in L^(IR) as discussed in the first 
part of the proof. Hence such a representation could have been assumed at the 
outset. 



Remark 13.4. In a recent paper on local quantum field theory [4], Borchers 
considers in his Theorem II. 9 a representation n of the {ax + 6)-group G on a 
Hilbert space H such that there is a conjugate linear J (that is a period-2 an- 
tiunitary) such that JnJ = w o t where r is the period-2 automorphism of G 
given by T{a, b) := (a, —6). In Borchers's example, the one-parameter subgroup 
b I— > n{l,b) has semibounded spectrum, and there is a unit- vector vq G H such 
that 7T{l,b)vo = Vo, V6 G M. The vector vq is cyclic and separating for a von Neu- 
mann algebra M such that 7r(l, 6)M7r(l, -6) C M, V6 G K+. Let a = e*, t G R. 
Then, in Borchers's construction, the other one-parameter subgroup 1 1-^ 7r(e*, 0) is 
the modular group A** associated with the cyclic and separating vector vq (from 
Tomita-Takesaki theory [5, vol. I]). Finally, J is the corresponding modular conju- 
gation satisfying JMJ = M' when M' is the commutant of M. 
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